Aug 03 08:39:09 devstack cinder-volume[77545]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:39:09 devstack cinder-volume[77545]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:39:09 devstack cinder-volume[77545]: we strongly recommend against using it for new projects. Aug 03 08:39:09 devstack cinder-volume[77545]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:39:09 devstack cinder-volume[77545]: framework. For more detail see Aug 03 08:39:09 devstack cinder-volume[77545]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:39:09 devstack cinder-volume[77545]: import eventlet # noqa Aug 03 08:39:12 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:39:12 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:39:12 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:39:13 devstack cinder-volume[77545]: INFO dbcounter [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Registered counter for database cinder Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG oslo_db.sqlalchemy.engines [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG dbcounter [-] [77545] Writer thread running {{(pid=77545) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:39:13 devstack cinder-volume[77545]: INFO cinder.rpc [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:39:13 devstack cinder-volume[77545]: INFO cinder.rpc [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG oslo_db.sqlalchemy.engines [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:39:13 devstack cinder-volume[77545]: INFO cinder.volume.manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Determined volume DB was empty at startup. Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG cinder.volume.manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77545) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:39:13 devstack cinder-volume[77545]: INFO cinder.volume.manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 08:39:13 devstack cinder-volume[77545]: WARNING stevedore.named [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:39:13 devstack cinder-volume[77545]: WARNING castellan.key_manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:39:13 devstack cinder-volume[77545]: WARNING cinder.keymgr.conf_key_mgr [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG cinder.volume.drivers.lvm [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77545) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 03 08:39:13 devstack cinder-volume[77545]: DEBUG oslo_concurrency.processutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77545) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_concurrency.processutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] CMD "cinder-rtstool verify" returned: 0 in 0.435s {{(pid=77545) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_db.sqlalchemy.engines [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:39:14 devstack cinder-volume[77545]: INFO cinder.rpc [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 03 08:39:14 devstack cinder-volume[77545]: INFO cinder.rpc [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 03 08:39:14 devstack cinder-volume[77545]: WARNING stevedore.named [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:39:14 devstack cinder-volume[77545]: WARNING castellan.key_manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:39:14 devstack cinder-volume[77545]: INFO cinder.volume.manager [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_db.sqlalchemy.engines [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77545) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:39:14 devstack cinder-volume[77545]: INFO oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Starting 1 workers Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Started child 77763 {{(pid=77545) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Full set of CONF: {{(pid=77545) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] ******************************************************************************** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Configuration options gathered from: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] ================================================================================ {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] allow_availability_zone_fallback = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77763]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] allow_compression_on_image_upload = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] allowed_direct_url_schemes = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] api_rate_limit = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] auth_strategy = keystone {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] az_cache_duration = 3600 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_availability_zone = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_host = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_stats_polling_interval = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backup_api_class = cinder.backup.api.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backup_name_template = backup-%s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backup_use_same_host = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backup_use_temp_snapshot = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] chap_password = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] chap_username = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_internal_tenant_project_id = 6fba7540746c4370bd52387b653f8fa3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_internal_tenant_user_id = fdd38dc9f4834bfa9bf0c57934b5bbc9 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cloned_volume_same_az = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cluster = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] compression_format = gzip {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] compute_api_class = cinder.compute.nova.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] config_dir = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] config_source = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] control_exchange = openstack {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] debug = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] default_availability_zone = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] default_group_type = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] default_volume_type = lvmdriver-1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] disk_geometry = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_client_cert = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_client_cert_key = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_data_namespace = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_ssl_cert_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_ssl_cert_verify = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] driver_use_ssl = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] enable_force_upload = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] enable_new_services = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] enable_unsupported_driver = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] enabled_backends = ['lvmdriver-1'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] enforce_multipath_for_image_xfer = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] filter_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_api_insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_api_servers = ['http://192.168.122.52/image'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_api_ssl_compression = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_ca_certificates_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_catalog_info = image:glance:publicURL {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_num_retries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance_request_timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] goodness_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] graceful_shutdown_timeout = 5 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] group_api_class = cinder.group.api.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] host = devstack {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_compress_on_upload = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_conversion_address_space_limit = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_conversion_cpu_limit = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_conversion_disable = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_upload_use_cinder_backend = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_upload_use_internal_tenant = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_volume_cache_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_volume_cache_max_count = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] image_volume_cache_max_size_gb = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] init_host_max_objects_retrieval = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] instance_format = [instance: %(uuid)s] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iscsi_target_flags = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iscsi_write_cache = on {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iser_helper = tgtadm {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iser_ip_address = 192.168.122.52 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iser_port = 3260 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_color = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_config_append = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_dir = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_options = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_rotate_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_rotate_interval_type = days {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] log_rotation_type = none {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] max_age = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] max_logfile_count = 30 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] max_logfile_size_mb = 200 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] max_over_subscription_ratio = 20.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] message_reap_interval = 86400 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] message_ttl = 2592000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] migration_create_volume_timeout_secs = 300 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] monkey_patch = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] monkey_patch_modules = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] my_ip = 192.168.122.52 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] no_snapshot_gb_quota = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] num_iser_scan_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] num_shell_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] num_volume_device_scan_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] nvmeof_conn_info_version = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] nvmet_ns_id = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77763]: INFO cinder.volume.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] nvmet_port_id = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_max_limit = 1000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_ext_list = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_listen = 0.0.0.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_listen_port = 8776 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_use_ssl = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] osapi_volume_workers = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] per_volume_size_limit = -1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] periodic_fuzzy_delay = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] periodic_interval = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] project_id_regex = [0-9a-f\-]+ {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] public_endpoint = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] publish_errors = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_backup_gigabytes = 1000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_backups = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_gigabytes = 1000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_groups = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_snapshots = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] quota_volumes = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] rate_limit_burst = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] rate_limit_except_level = CRITICAL {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] rate_limit_interval = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] reinit_driver_count = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] replication_device = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] report_discard_supported = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] report_interval = 120 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] reservation_clean_interval = 86400 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] reservation_expire = 86400 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] reserved_image_namespaces = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] reserved_percentage = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] rpc_response_timeout = 120 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] run_external_periodic_tasks = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] scst_target_driver = iscsi {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] scst_target_iqn_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_down_time = 720 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] shell_completion = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] snapshot_name_template = snapshot-%s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] snapshot_same_host = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] split_loggers = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] state_path = /opt/stack/data/cinder {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] storage_availability_zone = nova {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] storage_protocol = iSCSI {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] syslog_log_facility = LOG_USER {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_helper = lioadm {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_ip_address = 192.168.122.52 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_port = 3260 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_protocol = iscsi {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] target_secondary_ip_addresses = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] trace_flags = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] transfer_api_class = cinder.transfer.api.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] transport_url = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] until_refresh = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_chap_auth = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_default_quota_class = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_journal = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_json = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_multipath_for_image_xfer = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_stderr = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] use_syslog = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] verify_glance_signatures = enabled {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_api_class = cinder.volume.api.API {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_backend_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_clear = zero {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_clear_ionice = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_clear_size = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_copy_bps_limit = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_dd_blocksize = 1M {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_name_template = volume-%s {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_service_inithost_offload = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volume_usage_audit_period = month {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] zoning_mode = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_concurrency.disable_process_locking = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.auth_section = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.auth_type = password {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.auth_version = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.cache = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.delay_auth_decision = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.http_connect_timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.include_service_catalog = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.interface = public {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_password = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcache_username = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.region_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.service_token_roles_required = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.service_type = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.token_cache_time = 300 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.52/identity {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.backend = dogpile.cache.null {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.backend_argument = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.backend_expiration_time = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.config_prefix = cache.oslo {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.debug_cache_backend = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.enable_retry_client = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.enable_socket_keepalive = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.expiration_time = 600 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.hashclient_retry_attempts = 2 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_dead_retry = 300 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_pool_maxsize = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_sasl_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.password = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.proxies = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.redis_db = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.redis_sentinel_service_name = mymaster {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.redis_server = localhost:6379 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.retry_attempts = 2 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.retry_delay = 0.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.socket_keepalive_count = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.socket_keepalive_idle = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.socket_keepalive_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.socket_timeout = 1.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.tls_allowed_ciphers = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.tls_cafile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.tls_certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.tls_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.tls_keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cache.username = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] coordination.backend_url = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.asyncio_connection = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.asyncio_slave_connection = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.backend = sqlalchemy {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.connection = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.connection_debug = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.connection_parameters = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.connection_recycle_time = 3600 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.connection_trace = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.db_inc_retry_interval = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.db_max_retries = 20 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.db_max_retry_interval = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.db_retry_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.max_overflow = 50 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.max_pool_size = 5 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.max_retries = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.mysql_wsrep_sync_wait = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.pool_timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.retry_interval = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.slave_connection = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.sqlite_synchronous = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.synchronous_reader = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] database.use_db_reconnect = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.connection_string = messaging:// {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.es_doc_type = notification {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.es_scroll_size = 10000 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.es_scroll_time = 2m {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.filter_error_trace = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.hmac_keys = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.sentinel_service_name = mymaster {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.socket_timeout = 0.1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.trace_requests = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler.trace_sqlalchemy = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler_jaeger.process_tags = {} {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler_jaeger.service_name_prefix = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] profiler_otlp.service_name_prefix = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.enforce_new_defaults = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.policy_default_rule = default {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.policy_file = policy.yaml {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_policy.remote_timeout = 60.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.group = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.helper_command = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] privsep_osbrick.user = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.group = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.helper_command = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] cinder_sys_admin.user = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.auth_section = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.auth_type = password {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.cafile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.collect_timing = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.send_service_user_token = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.split_loggers = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] service_user.timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.auth_section = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.auth_type = password {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack sudo[77819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 03 08:39:14 devstack sudo[77819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.collect_timing = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.region_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.split_loggers = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] glance.timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.backend_availability_zone = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.chap_password = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.chap_username = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.disk_geometry = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_client_cert = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_client_cert_key = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_data_namespace = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.driver_use_ssl = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.enable_unsupported_driver = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.extra_capabilities = {} {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.filter_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.goodness_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iscsi_target_flags = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iscsi_write_cache = on {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iser_helper = tgtadm {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iser_ip_address = 192.168.122.52 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iser_port = 3260 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.lvm_mirrors = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.lvm_share_target = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.lvm_type = auto {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.num_shell_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.nvmet_port_id = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.replication_device = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.report_discard_supported = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.reserved_percentage = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.scst_target_driver = iscsi {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.scst_target_iqn_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.storage_protocol = iSCSI {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_helper = tgtadm {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_ip_address = 192.168.122.52 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_port = 3260 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_protocol = iscsi {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.trace_flags = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.unique_fqdn_network = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.use_chap_auth = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_backend_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_clear = zero {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_clear_ionice = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_clear_size = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volume_group = cinder-volumes {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_reports.file_event_handler = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_reports.log_dir = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.backend_availability_zone = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.backend_host = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.chap_password = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.chap_username = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.chiscsi_conf = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.disk_geometry = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_client_cert = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_data_namespace = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.driver_use_ssl = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.extra_capabilities = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.filter_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.goodness_function = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iser_helper = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iser_ip_address = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iser_port = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.iser_target_prefix = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.lvm_conf_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.lvm_mirrors = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.lvm_share_target = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.lvm_type = auto {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.num_shell_tries = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.nvmet_port_id = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.replication_device = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.report_discard_supported = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.reserved_percentage = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.scst_target_driver = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.storage_protocol = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_helper = lioadm {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_ip_address = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_port = 3260 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_protocol = iscsi {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.trace_flags = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.use_chap_auth = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_clear = zero {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_clear_size = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] lvmdriver-1.volumes_dir = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.ssl_version = {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_notifications.driver = [] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_notifications.retry = -1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] oslo_messaging_notifications.transport_url = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] key_manager.fixed_key = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.barbican_api_version = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.barbican_endpoint = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.barbican_endpoint_type = public {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.barbican_region_name = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.cafile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.collect_timing = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.number_of_retries = 60 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.retry_delay = 1 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.send_service_user_token = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.split_loggers = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.verify_ssl = True {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican.verify_ssl_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.auth_section = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.auth_type = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.cafile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.certfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.collect_timing = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.insecure = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.keyfile = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.split_loggers = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] barbican_service_user.timeout = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.approle_role_id = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.approle_secret_id = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.auth_method = approle {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.auth_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.kv_mountpoint = secret {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.kv_path = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.kv_version = 2 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.namespace = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.root_token_id = **** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.ssl_ca_crt_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.timeout = 60.0 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.token_file = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.token_role = None {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.use_ssl = False {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:39:14 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] ******************************************************************************** {{(pid=77545) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:39:15 devstack sudo[77819]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:15 devstack sudo[77887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:15 devstack sudo[77887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:15 devstack sudo[77887]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.264s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:39:15 devstack cinder-volume[77763]: INFO cinder.brick.local_dev.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:15 devstack sudo[77984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:15 devstack sudo[77984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:15 devstack sudo[77984]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG cinder.brick.local_dev.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77763) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 03 08:39:15 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:15 devstack sudo[78059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:15 devstack sudo[78059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:16 devstack sudo[78059]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.549s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:16 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:16 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack sudo[78290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 03 08:39:16 devstack sudo[78290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:16 devstack sudo[78290]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.319s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:16 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:16 devstack sudo[78375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:16 devstack sudo[78375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[78375]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack sudo[78378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:17 devstack sudo[78378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[78378]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack sudo[78431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:17 devstack sudo[78431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[78431]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack sudo[78470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:17 devstack sudo[78470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:17 devstack sudo[78470]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:17 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[78474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:18 devstack sudo[78474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:18 devstack sudo[78474]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[77763]: INFO cinder.volume.drivers.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[78484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:18 devstack sudo[78484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:18 devstack sudo[78484]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[78487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:18 devstack sudo[78487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:18 devstack sudo[78487]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:18 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:18 devstack sudo[78491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:18 devstack sudo[78491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack sudo[78491]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:19 devstack sudo[78494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:19 devstack sudo[78494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack sudo[78494]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:19 devstack sudo[78497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:19 devstack sudo[78497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:19 devstack sudo[78497]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:19 devstack cinder-volume[77763]: INFO cinder.volume.driver [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG cinder.volume.driver [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77763) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_db.sqlalchemy.engines [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writer thread running {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG cinder.db.api [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Building query based on filter {{(pid=77763) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG cinder.image.image_utils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77763) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:39:19 devstack cinder-volume[77763]: INFO cinder.keymgr.migration [None req-899dacc5-052b-4122-8cf4-dab8cea68039 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:39:19 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:19 devstack sudo[78502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:19 devstack sudo[78502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack sudo[78502]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:20 devstack sudo[78505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:20 devstack sudo[78505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack sudo[78505]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:20 devstack sudo[78508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:20 devstack sudo[78508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack sudo[78508]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:20 devstack sudo[78513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:20 devstack sudo[78513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:20 devstack sudo[78513]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG cinder.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Notifying Schedulers of capabilities ... {{(pid=77763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:39:20 devstack cinder-volume[77763]: INFO cinder.volume.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Driver initialization completed successfully. Aug 03 08:39:20 devstack cinder-volume[77763]: INFO cinder.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Initiating service 2 cleanup Aug 03 08:39:20 devstack cinder-volume[77763]: INFO cinder.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Service 2 cleanup completed. Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG cinder.service [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Creating RPC server for service cinder-volume {{(pid=77763) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:39:20 devstack cinder-volume[77763]: DEBUG cinder.service [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77763) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:39:21 devstack cinder-volume[77763]: INFO cinder.volume.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[78516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:39:21 devstack sudo[78516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[78516]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[78522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:21 devstack sudo[78522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[78522]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[78525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:39:21 devstack sudo[78525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:21 devstack sudo[78525]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:21 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:39:21 devstack sudo[78528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:39:21 devstack sudo[78528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:39:22 devstack sudo[78528]: pam_unix(sudo:session): session closed for user root Aug 03 08:39:22 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:39:22 devstack cinder-volume[77763]: INFO cinder.volume.manager [None req-a49170b4-e0fd-4c17-8e01-3cbe17af233d None None] Driver post RPC initialization completed successfully. Aug 03 08:39:24 devstack cinder-volume[77545]: DEBUG dbcounter [-] [77545] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77545) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:39:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:SELECT=4 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:39:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:39:34 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager._thread_info {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:39:34 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread count: 6 {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:39:34 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread info: [<_MainThread(MainThread, started 126208774234240)>, , , , , ] {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:34 devstack sudo[80805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:40:34 devstack sudo[80805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:34 devstack sudo[80805]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:34 devstack sudo[80808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:40:34 devstack sudo[80808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:34 devstack sudo[80808]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:34 devstack sudo[80841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:40:34 devstack sudo[80841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:34 devstack sudo[80841]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.271s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:40:34 devstack sudo[80924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:40:34 devstack sudo[80924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:40:35 devstack sudo[80924]: pam_unix(sudo:session): session closed for user root Aug 03 08:40:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:40:35 devstack cinder-volume[77763]: DEBUG cinder.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Notifying Schedulers of capabilities ... {{(pid=77763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:40:35 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager._thread_info {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:40:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread count: 6 {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:40:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread info: [<_MainThread(MainThread, started 126208774234240)>, , , , , ] {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:41:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:SELECT=1 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:41:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:UPDATE=1 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[84033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:41:34 devstack sudo[84033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack sudo[84033]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[84036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:41:34 devstack sudo[84036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:34 devstack sudo[84036]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:34 devstack sudo[84039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:41:34 devstack sudo[84039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:35 devstack sudo[84039]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:41:35 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:41:35 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:41:35 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG cinder.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Notifying Schedulers of capabilities ... {{(pid=77763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager._thread_info {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread count: 6 {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:41:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread info: [<_MainThread(MainThread, started 126208774234240)>, , , , , ] {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:34 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:42:34 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:34 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:34 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:42:34 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:34 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:34 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:42:34 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:34 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:42:34 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:42:34 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:42:35 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Aug 03 08:42:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:42:35 devstack cinder-volume[77763]: DEBUG cinder.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Notifying Schedulers of capabilities ... {{(pid=77763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:43:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:SELECT=1 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:32 devstack cinder-volume[77763]: DEBUG dbcounter [-] [77763] Writing DB stats cinder:UPDATE=1 {{(pid=77763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG cinder.volume.drivers.lvm [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Updating volume stats {{(pid=77763) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:34 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 08:43:34 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:34 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:34 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:43:34 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:34 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:34 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:34 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 08:43:34 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:34 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:43:35 devstack sudo[87314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 08:43:35 devstack sudo[87314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:43:35 devstack sudo[87314]: pam_unix(sudo:session): session closed for user root Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG oslo_concurrency.processutils [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=77763) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG cinder.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Notifying Schedulers of capabilities ... {{(pid=77763) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG oslo_service.periodic_task [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] Running periodic task VolumeManager._thread_info {{(pid=77763) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread count: 6 {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:43:35 devstack cinder-volume[77763]: DEBUG cinder.volume.manager [None req-536ad404-43e6-422d-9bd9-acbb24f6d4f1 None None] thread info: [<_MainThread(MainThread, started 126208774234240)>, , , , , ] {{(pid=77763) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:43:55 devstack cinder-volume[77545]: INFO oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Caught SIGTERM, stopping children Aug 03 08:43:55 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Acquiring lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:43:55 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Acquired lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:43:55 devstack cinder-volume[77545]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Releasing lock "singleton_lock" {{(pid=77545) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:43:55 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Stop services. {{(pid=77545) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 08:43:55 devstack cinder-volume[77545]: DEBUG oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Killing children. {{(pid=77545) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 08:43:55 devstack cinder-volume[77545]: INFO oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Waiting on 1 children to exit Aug 03 08:43:56 devstack cinder-volume[77763]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Acquiring lock "singleton_lock" {{(pid=77763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:43:56 devstack cinder-volume[77763]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Acquired lock "singleton_lock" {{(pid=77763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:43:56 devstack cinder-volume[77763]: DEBUG oslo_concurrency.lockutils [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Releasing lock "singleton_lock" {{(pid=77763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:43:56 devstack cinder-volume[77763]: WARNING amqp [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:43:56 devstack cinder-volume[77763]: WARNING amqp [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:43:56 devstack cinder-volume[77545]: INFO oslo_service.backend._eventlet.service [None req-7c8cc335-0bb5-42a0-90de-2f357570218c None None] Child 77763 exited with status 0 Aug 03 08:43:56 devstack cinder-volume[87828]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:43:56 devstack cinder-volume[87828]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:43:56 devstack cinder-volume[87828]: we strongly recommend against using it for new projects. Aug 03 08:43:56 devstack cinder-volume[87828]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:43:56 devstack cinder-volume[87828]: framework. For more detail see Aug 03 08:43:56 devstack cinder-volume[87828]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:43:56 devstack cinder-volume[87828]: import eventlet # noqa Aug 03 08:43:58 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:43:58 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:43:58 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:43:59 devstack cinder-volume[87828]: INFO dbcounter [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Registered counter for database cinder Aug 03 08:43:59 devstack cinder-volume[87828]: DEBUG oslo_db.sqlalchemy.engines [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:43:59 devstack cinder-volume[87828]: DEBUG dbcounter [-] [87828] Writer thread running {{(pid=87828) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:43:59 devstack cinder-volume[87828]: INFO cinder.rpc [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:43:59 devstack cinder-volume[87828]: INFO cinder.rpc [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:43:59 devstack cinder-volume[87828]: DEBUG oslo_db.sqlalchemy.engines [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:43:59 devstack cinder-volume[87828]: INFO cinder.volume.manager [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Determined volume DB was empty at startup. Aug 03 08:43:59 devstack cinder-volume[87828]: DEBUG cinder.volume.manager [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87828) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:44:00 devstack cinder-volume[87828]: INFO cinder.volume.manager [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 08:44:00 devstack cinder-volume[87828]: WARNING stevedore.named [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:44:00 devstack cinder-volume[87828]: WARNING castellan.key_manager [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:44:00 devstack cinder-volume[87828]: WARNING cinder.keymgr.conf_key_mgr [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:44:00 devstack cinder-volume[87828]: INFO cinder.volume.manager [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_db.sqlalchemy.engines [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:00 devstack cinder-volume[87828]: INFO oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Starting 1 workers Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Started child 88060 {{(pid=87828) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Full set of CONF: {{(pid=87828) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] ******************************************************************************** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Configuration options gathered from: {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] ================================================================================ {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] allow_availability_zone_fallback = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] allow_compression_on_image_upload = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] allowed_direct_url_schemes = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] api_rate_limit = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] auth_strategy = keystone {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_availability_zone = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_host = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_stats_polling_interval = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backup_api_class = cinder.backup.api.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backup_name_template = backup-%s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backup_use_same_host = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backup_use_temp_snapshot = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] chap_password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] chap_username = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_internal_tenant_project_id = 6fba7540746c4370bd52387b653f8fa3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_internal_tenant_user_id = fdd38dc9f4834bfa9bf0c57934b5bbc9 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cluster = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] compression_format = gzip {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] compute_api_class = cinder.compute.nova.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] config_dir = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] config_source = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] control_exchange = openstack {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] debug = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] default_availability_zone = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] default_group_type = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[88060]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] default_volume_type = QuobyteHD {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] disk_geometry = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_client_cert = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_client_cert_key = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_data_namespace = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_ssl_cert_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_ssl_cert_verify = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] driver_use_ssl = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] enable_new_services = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] enable_unsupported_driver = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] enabled_backends = ['QuobyteHD'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] enforce_multipath_for_image_xfer = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] filter_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_api_insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_api_servers = ['http://192.168.122.52/image'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_api_ssl_compression = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_ca_certificates_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_catalog_info = image:glance:publicURL {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_num_retries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance_request_timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] goodness_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] graceful_shutdown_timeout = 5 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] group_api_class = cinder.group.api.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] host = devstack {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_compress_on_upload = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_conversion_address_space_limit = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_conversion_cpu_limit = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_conversion_disable = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_upload_use_cinder_backend = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_upload_use_internal_tenant = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_volume_cache_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_volume_cache_max_count = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] image_volume_cache_max_size_gb = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] init_host_max_objects_retrieval = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] instance_format = [instance: %(uuid)s] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iscsi_target_flags = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iscsi_write_cache = on {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iser_helper = tgtadm {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iser_ip_address = 192.168.122.52 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iser_port = 3260 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_color = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_config_append = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_dir = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_options = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_rotate_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_rotate_interval_type = days {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] log_rotation_type = none {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] max_age = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] max_logfile_count = 30 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] max_logfile_size_mb = 200 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] max_over_subscription_ratio = 20.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] message_reap_interval = 86400 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] message_ttl = 2592000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] migration_create_volume_timeout_secs = 300 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] monkey_patch = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] monkey_patch_modules = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] my_ip = 192.168.122.52 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] no_snapshot_gb_quota = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] num_iser_scan_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] num_shell_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[88060]: INFO cinder.volume.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Starting volume driver QuobyteDriver (1.2) Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] num_volume_device_scan_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] nvmeof_conn_info_version = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] nvmet_ns_id = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] nvmet_port_id = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_max_limit = 1000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_ext_list = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.remotefs [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88060) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_listen_port = 8776 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_use_ssl = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] osapi_volume_workers = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] per_volume_size_limit = -1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] periodic_fuzzy_delay = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] periodic_interval = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] public_endpoint = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] publish_errors = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_backup_gigabytes = 1000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_backups = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_gigabytes = 1000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_groups = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_snapshots = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] quota_volumes = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] rate_limit_burst = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] rate_limit_except_level = CRITICAL {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] rate_limit_interval = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] reinit_driver_count = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] replication_device = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] report_discard_supported = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] report_interval = 120 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] reservation_clean_interval = 86400 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] reservation_expire = 86400 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] reserved_image_namespaces = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] reserved_percentage = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] rpc_response_timeout = 120 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] run_external_periodic_tasks = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] scst_target_driver = iscsi {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] scst_target_iqn_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_down_time = 720 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] shell_completion = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] snapshot_name_template = snapshot-%s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] split_loggers = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] state_path = /opt/stack/data/cinder {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] storage_availability_zone = nova {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] storage_protocol = iSCSI {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] syslog_log_facility = LOG_USER {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_helper = lioadm {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_ip_address = 192.168.122.52 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_port = 3260 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_protocol = iscsi {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] target_secondary_ip_addresses = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] trace_flags = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] transport_url = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] until_refresh = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_chap_auth = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_default_quota_class = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_journal = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_json = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_multipath_for_image_xfer = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_stderr = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] use_syslog = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] verify_glance_signatures = enabled {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_api_class = cinder.volume.api.API {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_backend_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_clear = zero {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_clear_ionice = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_clear_size = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_copy_bps_limit = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_dd_blocksize = 1M {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_name_template = volume-%s {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_service_inithost_offload = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volume_usage_audit_period = month {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] zoning_mode = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_concurrency.disable_process_locking = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88060) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 08:44:00 devstack cinder-volume[88060]: WARNING cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 08:44:00 devstack cinder-volume[88060]: WARNING cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Running cmd (subprocess): mount.quobyte {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.auth_section = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.auth_type = password {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.auth_version = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.cache = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.include_service_catalog = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.interface = public {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_password = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcache_username = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.region_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.service_type = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.52/identity {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.backend = dogpile.cache.null {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.backend_argument = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.backend_expiration_time = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.config_prefix = cache.oslo {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.debug_cache_backend = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.enable_retry_client = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.enable_socket_keepalive = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.expiration_time = 600 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.hashclient_retry_attempts = 2 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_dead_retry = 300 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_pool_maxsize = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_sasl_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.proxies = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.redis_db = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.redis_server = localhost:6379 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.retry_attempts = 2 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.retry_delay = 0.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.socket_keepalive_count = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.socket_keepalive_idle = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.socket_keepalive_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.socket_timeout = 1.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.tls_allowed_ciphers = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.tls_cafile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.tls_certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.tls_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.tls_keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cache.username = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] coordination.backend_url = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.asyncio_connection = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.asyncio_slave_connection = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.backend = sqlalchemy {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.connection = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.connection_debug = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.connection_parameters = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.connection_recycle_time = 3600 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.connection_trace = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.db_inc_retry_interval = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.db_max_retries = 20 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.db_max_retry_interval = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.db_retry_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.max_overflow = 50 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.max_pool_size = 5 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.max_retries = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.mysql_wsrep_sync_wait = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.pool_timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.retry_interval = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.slave_connection = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.sqlite_synchronous = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.synchronous_reader = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] database.use_db_reconnect = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.connection_string = messaging:// {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.es_doc_type = notification {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.es_scroll_size = 10000 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.es_scroll_time = 2m {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.filter_error_trace = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack quobyte-client[88071]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 08:44:00 devstack quobyte-client[88071]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.hmac_keys = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.sentinel_service_name = mymaster {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.socket_timeout = 0.1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.trace_requests = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler.trace_sqlalchemy = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler_jaeger.process_tags = {} {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler_jaeger.service_name_prefix = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] profiler_otlp.service_name_prefix = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.enforce_new_defaults = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] CMD "mount.quobyte" returned: 1 in 0.097s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.policy_default_rule = default {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.policy_file = policy.yaml {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.group = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.helper_command = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: INFO cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef ... Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 -c /etc/quobyte/client-cinder.cfg {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] privsep_osbrick.user = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.group = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.helper_command = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] cinder_sys_admin.user = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.auth_section = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.auth_type = password {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.cafile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.collect_timing = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.send_service_user_token = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.split_loggers = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] service_user.timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.auth_section = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.auth_type = password {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.collect_timing = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.region_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.split_loggers = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] glance.timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.backend_availability_zone = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.chap_password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.chap_username = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.disk_geometry = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_client_cert = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_client_cert_key = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_data_namespace = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.driver_use_ssl = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.extra_capabilities = {} {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.filter_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.goodness_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iscsi_target_flags = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iscsi_write_cache = on {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iser_helper = tgtadm {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iser_ip_address = 192.168.122.52 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 -c /etc/quobyte/client-cinder.cfg Aug 03 08:44:00 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iser_port = 3260 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_host = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_login = admin {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_mount_options = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_private_key = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_share_path = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.num_shell_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.quobyte_volume_url = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.replication_device = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.report_discard_supported = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.reserved_percentage = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_helper = tgtadm {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_ip_address = 192.168.122.52 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_port = 3260 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_protocol = iscsi {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.trace_flags = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.unique_fqdn_network = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.use_chap_auth = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_backend_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_clear = zero {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_clear_ionice = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_clear_size = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_reports.file_event_handler = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_reports.log_dir = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.backend_availability_zone = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.backend_host = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.chap_password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.chap_username = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.chiscsi_conf = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.disk_geometry = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_client_cert = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_data_namespace = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.driver_use_ssl = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.extra_capabilities = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.filter_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.goodness_function = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iser_helper = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iser_ip_address = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iser_port = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.iser_target_prefix = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_host = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_login = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_mount_options = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_password = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_private_key = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_share_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_ssh_port = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.num_shell_tries = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.nvmet_port_id = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.replication_device = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.report_discard_supported = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.reserved_percentage = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.scst_target_driver = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.storage_protocol = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_helper = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_ip_address = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_port = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_prefix = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_protocol = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.trace_flags = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.use_chap_auth = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_clear = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_clear_size = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] QuobyteHD.volumes_dir = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_notifications.driver = [] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_notifications.retry = -1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] key_manager.fixed_key = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.barbican_api_version = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.barbican_endpoint = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.barbican_endpoint_type = public {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.barbican_region_name = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.cafile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.collect_timing = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.number_of_retries = 60 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.retry_delay = 1 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.send_service_user_token = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.split_loggers = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.verify_ssl = True {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican.verify_ssl_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.auth_section = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.auth_type = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.cafile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.certfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.collect_timing = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.insecure = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.keyfile = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.split_loggers = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] barbican_service_user.timeout = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.approle_role_id = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.approle_secret_id = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.auth_method = approle {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.auth_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.kv_mountpoint = secret {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.kv_path = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.kv_version = 2 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.namespace = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.root_token_id = **** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.ssl_ca_crt_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.timeout = 60.0 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.token_file = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.token_role = None {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.use_ssl = False {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:00 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] ******************************************************************************** {{(pid=87828) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:44:00 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.439s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:00 devstack cinder-volume[88060]: INFO cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef succeeded Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.471s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:00 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:00 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:00 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:01 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.274s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.volume.driver [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.volume.driver [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7364234924316, 'free_capacity_gb': 1775.7364234924316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88060) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_db.sqlalchemy.engines [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG dbcounter [-] [88060] Writer thread running {{(pid=88060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.db.api [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Building query based on filter {{(pid=88060) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.image.image_utils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88060) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.keymgr.migration [None req-39de2b81-ac6c-4e65-b5e5-0677dc5b223d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:01 devstack sudo[88163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:01 devstack sudo[88163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:01 devstack sudo[88163]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.247s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Notifying Schedulers of capabilities ... {{(pid=88060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.volume.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Driver initialization completed successfully. Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Initiating service 3 cleanup Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Service 3 cleanup completed. Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.service [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Creating RPC server for service cinder-volume {{(pid=88060) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.service [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88060) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:44:01 devstack cinder-volume[88060]: INFO cinder.volume.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:01 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:01 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:01 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:02 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:02 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.289s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:02 devstack cinder-volume[88060]: INFO cinder.volume.manager [None req-2a065cc8-8ae6-40bb-a5d8-d9bf4f880c79 None None] Driver post RPC initialization completed successfully. Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG cinder.volume.drivers.quobyte [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:06 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:06 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:06 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:07 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:07 devstack cinder-volume[88060]: DEBUG oslo_concurrency.processutils [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.218s {{(pid=88060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:07 devstack cinder-volume[88060]: DEBUG cinder.manager [None req-e946f6bd-0ef7-4416-bb7d-646566924011 None None] Notifying Schedulers of capabilities ... {{(pid=88060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:10 devstack cinder-volume[87828]: INFO oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Caught SIGTERM, stopping children Aug 03 08:44:10 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Acquiring lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:44:10 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Acquired lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:44:10 devstack cinder-volume[87828]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Releasing lock "singleton_lock" {{(pid=87828) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:44:10 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Stop services. {{(pid=87828) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 08:44:10 devstack cinder-volume[87828]: DEBUG oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Killing children. {{(pid=87828) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 08:44:10 devstack cinder-volume[87828]: INFO oslo_service.backend._eventlet.service [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Waiting on 1 children to exit Aug 03 08:44:12 devstack cinder-volume[88060]: DEBUG dbcounter [-] [88060] Writing DB stats cinder:SELECT=4 {{(pid=88060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:12 devstack cinder-volume[88060]: DEBUG dbcounter [-] [88060] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:15 devstack cinder-volume[88060]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 03 08:44:15 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Acquiring lock "singleton_lock" {{(pid=88060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:44:15 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Acquired lock "singleton_lock" {{(pid=88060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:44:15 devstack cinder-volume[88060]: DEBUG oslo_concurrency.lockutils [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Releasing lock "singleton_lock" {{(pid=88060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:44:15 devstack cinder-volume[88060]: WARNING amqp [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:44:15 devstack cinder-volume[88060]: WARNING amqp [None req-62c0dcce-e547-45a0-86d6-07f7e1766181 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 08:44:15 devstack cinder-volume[88554]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 08:44:15 devstack cinder-volume[88554]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:44:15 devstack cinder-volume[88554]: we strongly recommend against using it for new projects. Aug 03 08:44:15 devstack cinder-volume[88554]: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:44:15 devstack cinder-volume[88554]: framework. For more detail see Aug 03 08:44:15 devstack cinder-volume[88554]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:44:15 devstack cinder-volume[88554]: import eventlet # noqa Aug 03 08:44:18 devstack cinder-volume[88554]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 08:44:18 devstack cinder-volume[88554]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 08:44:18 devstack cinder-volume[88554]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88554) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 08:44:18 devstack cinder-volume[88554]: INFO dbcounter [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Registered counter for database cinder Aug 03 08:44:18 devstack cinder-volume[88554]: DEBUG oslo_db.sqlalchemy.engines [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG dbcounter [-] [88554] Writer thread running {{(pid=88554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:44:19 devstack cinder-volume[88554]: INFO cinder.rpc [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 08:44:19 devstack cinder-volume[88554]: INFO cinder.rpc [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_db.sqlalchemy.engines [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:19 devstack cinder-volume[88554]: INFO cinder.volume.manager [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Determined volume DB was empty at startup. Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG cinder.volume.manager [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88554) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 08:44:19 devstack cinder-volume[88554]: WARNING stevedore.named [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 08:44:19 devstack cinder-volume[88554]: WARNING castellan.key_manager [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:44:19 devstack cinder-volume[88554]: WARNING cinder.keymgr.conf_key_mgr [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 08:44:19 devstack cinder-volume[88554]: INFO cinder.volume.manager [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_db.sqlalchemy.engines [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88554) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:19 devstack cinder-volume[88554]: INFO oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Starting 1 workers Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Started child 88796 {{(pid=88554) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Full set of CONF: {{(pid=88554) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] ******************************************************************************** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] Configuration options gathered from: {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] ================================================================================ {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] allow_availability_zone_fallback = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] allow_compression_on_image_upload = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] allowed_direct_url_schemes = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] api_rate_limit = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] auth_strategy = keystone {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88796]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_availability_zone = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_host = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_stats_polling_interval = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backup_api_class = cinder.backup.api.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backup_name_template = backup-%s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backup_use_same_host = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backup_use_temp_snapshot = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] chap_password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] chap_username = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_internal_tenant_project_id = 6fba7540746c4370bd52387b653f8fa3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_internal_tenant_user_id = fdd38dc9f4834bfa9bf0c57934b5bbc9 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cluster = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] compression_format = gzip {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] compute_api_class = cinder.compute.nova.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] config_dir = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] config_source = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] control_exchange = openstack {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] debug = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] default_availability_zone = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] default_group_type = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] default_volume_type = QuobyteHD {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] disk_geometry = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_client_cert = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_client_cert_key = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_data_namespace = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_ssl_cert_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_ssl_cert_verify = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] driver_use_ssl = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] enable_new_services = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] enable_unsupported_driver = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] enabled_backends = ['QuobyteHD'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] enforce_multipath_for_image_xfer = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] filter_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_api_insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_api_servers = ['http://192.168.122.52/image'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_api_ssl_compression = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_ca_certificates_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_catalog_info = image:glance:publicURL {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_num_retries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance_request_timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] goodness_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] graceful_shutdown_timeout = 5 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] group_api_class = cinder.group.api.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] host = devstack {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_compress_on_upload = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_conversion_address_space_limit = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_conversion_cpu_limit = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_conversion_disable = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_upload_use_cinder_backend = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_upload_use_internal_tenant = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_volume_cache_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_volume_cache_max_count = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] image_volume_cache_max_size_gb = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] init_host_max_objects_retrieval = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] instance_format = [instance: %(uuid)s] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iscsi_target_flags = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iscsi_write_cache = on {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iser_helper = tgtadm {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iser_ip_address = 192.168.122.52 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iser_port = 3260 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_color = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_config_append = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_dir = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_options = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_rotate_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_rotate_interval_type = days {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] log_rotation_type = none {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] max_age = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] max_logfile_count = 30 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] max_logfile_size_mb = 200 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] max_over_subscription_ratio = 20.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] message_reap_interval = 86400 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] message_ttl = 2592000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] migration_create_volume_timeout_secs = 300 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] monkey_patch = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] monkey_patch_modules = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] my_ip = 192.168.122.52 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] no_snapshot_gb_quota = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] num_iser_scan_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] num_shell_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] num_volume_device_scan_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] nvmeof_conn_info_version = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] nvmet_ns_id = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] nvmet_port_id = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_max_limit = 1000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_ext_list = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_listen_port = 8776 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_use_ssl = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] osapi_volume_workers = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] per_volume_size_limit = -1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] periodic_fuzzy_delay = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] periodic_interval = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] public_endpoint = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] publish_errors = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_backup_gigabytes = 1000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_backups = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_gigabytes = 1000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Starting volume driver QuobyteDriver (1.2) Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_groups = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88796) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_snapshots = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] quota_volumes = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] rate_limit_burst = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] rate_limit_except_level = CRITICAL {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] rate_limit_interval = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] reinit_driver_count = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] replication_device = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] report_discard_supported = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] report_interval = 120 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] reservation_clean_interval = 86400 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] reservation_expire = 86400 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] reserved_image_namespaces = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] reserved_percentage = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] rpc_response_timeout = 120 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] run_external_periodic_tasks = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] scst_target_driver = iscsi {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] scst_target_iqn_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_down_time = 720 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] shell_completion = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] snapshot_name_template = snapshot-%s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] split_loggers = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] state_path = /opt/stack/data/cinder {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] storage_availability_zone = nova {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] storage_protocol = iSCSI {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] syslog_log_facility = LOG_USER {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_helper = lioadm {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_ip_address = 192.168.122.52 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_port = 3260 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_protocol = iscsi {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] target_secondary_ip_addresses = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] trace_flags = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] transport_url = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] until_refresh = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_chap_auth = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_default_quota_class = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_journal = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_json = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_multipath_for_image_xfer = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_stderr = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] use_syslog = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] verify_glance_signatures = enabled {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_api_class = cinder.volume.api.API {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_backend_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_clear = zero {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_clear_ionice = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_clear_size = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_copy_bps_limit = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_dd_blocksize = 1M {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_name_template = volume-%s {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_service_inithost_offload = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volume_usage_audit_period = month {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] zoning_mode = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_concurrency.disable_process_locking = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.auth_section = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.auth_type = password {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.auth_version = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.cache = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.include_service_catalog = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.interface = public {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_password = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcache_username = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.region_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.service_type = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.52/identity {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.backend = dogpile.cache.null {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.backend_argument = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.backend_expiration_time = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.config_prefix = cache.oslo {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.debug_cache_backend = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.enable_retry_client = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.enable_socket_keepalive = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.expiration_time = 600 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.hashclient_retry_attempts = 2 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_dead_retry = 300 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_pool_maxsize = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_sasl_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.proxies = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.redis_db = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.redis_server = localhost:6379 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.retry_attempts = 2 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.retry_delay = 0.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.socket_keepalive_count = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.socket_keepalive_idle = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.socket_keepalive_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.socket_timeout = 1.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.tls_allowed_ciphers = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.tls_cafile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.tls_certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.tls_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.tls_keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cache.username = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] coordination.backend_url = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.asyncio_connection = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.asyncio_slave_connection = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.backend = sqlalchemy {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.connection = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.connection_debug = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.connection_parameters = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.connection_recycle_time = 3600 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.connection_trace = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.db_inc_retry_interval = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.db_max_retries = 20 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88796) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 08:44:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 08:44:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.db_max_retry_interval = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.db_retry_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.max_overflow = 50 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.max_pool_size = 5 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.max_retries = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Running cmd (subprocess): mount.quobyte {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.mysql_wsrep_sync_wait = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.pool_timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.retry_interval = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.slave_connection = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.sqlite_synchronous = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.synchronous_reader = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] database.use_db_reconnect = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.connection_string = messaging:// {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.es_doc_type = notification {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.es_scroll_size = 10000 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.es_scroll_time = 2m {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.filter_error_trace = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.hmac_keys = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.sentinel_service_name = mymaster {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.socket_timeout = 0.1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.trace_requests = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler.trace_sqlalchemy = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler_jaeger.process_tags = {} {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler_jaeger.service_name_prefix = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] profiler_otlp.service_name_prefix = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.enforce_new_defaults = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.policy_default_rule = default {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.policy_file = policy.yaml {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.group = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.helper_command = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] privsep_osbrick.user = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.group = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.helper_command = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] cinder_sys_admin.user = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.auth_section = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.auth_type = password {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.cafile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.collect_timing = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.send_service_user_token = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.split_loggers = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] service_user.timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.auth_section = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.auth_type = password {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.collect_timing = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.region_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.split_loggers = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] glance.timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.backend_availability_zone = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.chap_password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.chap_username = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.disk_geometry = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_client_cert = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_client_cert_key = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_data_namespace = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.driver_use_ssl = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.extra_capabilities = {} {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.filter_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.goodness_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iscsi_target_flags = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iscsi_write_cache = on {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iser_helper = tgtadm {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iser_ip_address = 192.168.122.52 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iser_port = 3260 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_host = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_login = admin {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_mount_options = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_private_key = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_share_path = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.num_shell_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack quobyte-client[88800]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack quobyte-client[88800]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.quobyte_volume_url = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.replication_device = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] CMD "mount.quobyte" returned: 1 in 0.051s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.report_discard_supported = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.reserved_percentage = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_helper = tgtadm {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_ip_address = 192.168.122.52 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_port = 3260 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_protocol = iscsi {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.trace_flags = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.unique_fqdn_network = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.use_chap_auth = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_backend_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_clear = zero {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_clear_ionice = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_clear_size = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_reports.file_event_handler = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_reports.log_dir = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.backend_availability_zone = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.backend_host = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.chap_password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.chap_username = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.chiscsi_conf = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.disk_geometry = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_client_cert = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_data_namespace = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.driver_use_ssl = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.extra_capabilities = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.filter_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.goodness_function = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iser_helper = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iser_ip_address = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iser_port = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.iser_target_prefix = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_host = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_login = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_mount_options = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_password = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_private_key = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_share_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_ssh_port = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.num_shell_tries = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.nvmet_port_id = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.replication_device = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.report_discard_supported = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.reserved_percentage = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.scst_target_driver = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.storage_protocol = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_helper = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_ip_address = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_port = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_prefix = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_protocol = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.trace_flags = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.use_chap_auth = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_clear = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_clear_size = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] QuobyteHD.volumes_dir = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_notifications.driver = [] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_notifications.retry = -1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] key_manager.fixed_key = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.barbican_api_version = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.barbican_endpoint = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.barbican_endpoint_type = public {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.barbican_region_name = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.cafile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.collect_timing = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.number_of_retries = 60 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.retry_delay = 1 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.send_service_user_token = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.split_loggers = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.verify_ssl = True {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican.verify_ssl_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.auth_section = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.auth_type = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.cafile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.certfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.collect_timing = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.insecure = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.keyfile = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.split_loggers = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] barbican_service_user.timeout = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.approle_role_id = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.approle_secret_id = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.auth_method = approle {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.auth_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.kv_mountpoint = secret {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.kv_path = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.kv_version = 2 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.namespace = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.root_token_id = **** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.ssl_ca_crt_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.timeout = 60.0 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.token_file = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.token_role = None {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.use_ssl = False {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Aug 03 08:44:19 devstack cinder-volume[88554]: DEBUG oslo_service.backend._eventlet.service [None req-4e6bf006-688c-4a26-913f-6b7798091cd8 None None] ******************************************************************************** {{(pid=88554) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Aug 03 08:44:19 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.220s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:19 devstack cinder-volume[88796]: INFO cinder.volume.driver [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Driver hasn't implemented _init_vendor_properties() Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.driver [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7364234924316, 'free_capacity_gb': 1775.7364234924316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88796) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_db.sqlalchemy.engines [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88796) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writer thread running {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.db.api [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Building query based on filter {{(pid=88796) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88796) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.keymgr.migration [None req-852a9837-d4fd-4413-aa73-86b7f8204631 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 08:44:20 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:20 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:20 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.224s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Driver initialization completed successfully. Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Initiating service 3 cleanup Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Service 3 cleanup completed. Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.service [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Creating RPC server for service cinder-volume {{(pid=88796) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.service [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88796) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:44:20 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:44:20 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:44:20 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Aug 03 08:44:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.234s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:44:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e93a742e-b748-4eae-b401-2b4f21546d1f None None] Driver post RPC initialization completed successfully. Aug 03 08:44:29 devstack cinder-volume[88554]: DEBUG dbcounter [-] [88554] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88554) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:44:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:45:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:45:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 6 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:45:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:45:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Flow 'volume_create_manager' (d7596b60-899a-4f42-b20c-c7aa3a20c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de3a918-e5d7-4c17-b2bf-4ccb1d0f9a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de3a918-e5d7-4c17-b2bf-4ccb1d0f9a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-916159007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7b3412a8c44b68babfa6aca40b17eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:41Z,use_quota=True,user_id='97e712b36ba541428020d3c888dbdf30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fb2af4-be07-4f4c-85bd-e4ae2b3a8c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fb2af4-be07-4f4c-85bd-e4ae2b3a8c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df21ac3-ad65-4634-995e-07a947fa96a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df21ac3-ad65-4634-995e-07a947fa96a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e', 'volume_name': 'volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a620545b-1b04-436f-8255-355c7c648760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a620545b-1b04-436f-8255-355c7c648760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43d962-0196-4f20-a3f6-692f9a3ef852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Volume b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e', 'volume_size': 1} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-916159007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7b3412a8c44b68babfa6aca40b17eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:41Z,use_quota=True,user_id='97e712b36ba541428020d3c888dbdf30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Creating volume b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:42 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:45:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:42 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e 1073741824 Aug 03 08:45:42 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:43 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e 1073741824" returned: 0 in 1.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:43 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e Aug 03 08:45:43 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:44 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" returned: 0 in 0.732s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] <== create_volume: return (2195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43d962-0196-4f20-a3f6-692f9a3ef852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b9309-c300-4d89-8a82-609b90209763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Volume volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e (b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e): created successfully Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58b9309-c300-4d89-8a82-609b90209763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Flow 'volume_create_manager' (d7596b60-899a-4f42-b20c-c7aa3a20c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2eadfe95-214e-4559-ac49-0338be57def6 tempest-DeleteServersTestJSON-1001129580 None] Created volume successfully. Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Flow 'volume_create_manager' (629901c1-484c-4078-9588-a376cd89da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfc123f-6fae-4f8a-b661-67b2d71e5404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfc123f-6fae-4f8a-b661-67b2d71e5404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1101175627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdfccc-a2f4-4e15-8419-f33ea577bd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4bbaf377243959ff265b84609c463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:47Z,use_quota=True,user_id='3ec82615ac2c4a00b96106dc5742e35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f8dd61-7340-4b1d-8e96-a9cf836bfb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f8dd61-7340-4b1d-8e96-a9cf836bfb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b72d26-06c8-429f-888c-b9c720c4ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b72d26-06c8-429f-888c-b9c720c4ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ccdfccc-a2f4-4e15-8419-f33ea577bd18', 'volume_name': 'volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff51c76-b828-4d89-af6c-2e74eb0cd543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff51c76-b828-4d89-af6c-2e74eb0cd543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f711a9-eb6a-4e61-8426-1579aa6994ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Volume 2ccdfccc-a2f4-4e15-8419-f33ea577bd18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18', 'volume_size': 1} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1101175627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ccdfccc-a2f4-4e15-8419-f33ea577bd18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcc4bbaf377243959ff265b84609c463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:45:47Z,use_quota=True,user_id='3ec82615ac2c4a00b96106dc5742e35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Creating volume 2ccdfccc-a2f4-4e15-8419-f33ea577bd18 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:45:47 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:45:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:47 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 1073741824 Aug 03 08:45:47 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:48 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 1073741824" returned: 0 in 0.957s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:48 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 Aug 03 08:45:48 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:49 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" returned: 0 in 0.771s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f711a9-eb6a-4e61-8426-1579aa6994ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc83df-c6c7-4ba4-8b0c-b0a38019a72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:45:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Volume volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 (2ccdfccc-a2f4-4e15-8419-f33ea577bd18): created successfully Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bc83df-c6c7-4ba4-8b0c-b0a38019a72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:45:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Flow 'volume_create_manager' (629901c1-484c-4078-9588-a376cd89da19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:45:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b90ace78-ffd8-4078-85fb-c2bc7bb196fe tempest-VolumesAdminNegativeTest-1666725187 None] Created volume successfully. Aug 03 08:45:51 devstack cinder-volume[88796]: WARNING py.warnings [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 03 08:45:51 devstack cinder-volume[88796]: .first() Aug 03 08:45:51 devstack cinder-volume[88796]: Aug 03 08:45:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a32436a2-2fa2-45dd-a7fa-423ee12d7d54', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:45:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-aa07c250-1876-454c-aa7f-cfdd24fbec71 req-c621781e-8306-48d9-8878-6b4a4759b48f tempest-DeleteServersTestJSON-1001129580 None] attachment_update completed successfully. Aug 03 08:45:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Acquiring lock "cinder-2ccdfccc-a2f4-4e15-8419-f33ea577bd18-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "cinder-2ccdfccc-a2f4-4e15-8419-f33ea577bd18-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Acquiring lock "cinder-quobyte-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:45:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "cinder-quobyte-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:45:52 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp74h4h2lm/privsep.sock'] Aug 03 08:45:52 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp74h4h2lm/privsep.sock Aug 03 08:45:52 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 08:45:54 devstack cinder-volume[88796]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 03 08:45:54 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:54 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Spawned new privsep daemon via rootwrap Aug 03 08:45:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Accepted privsep connection to /tmp/tmp74h4h2lm/privsep.sock {{(pid=88796) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 03 08:45:54 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 03 08:45:54 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 03 08:45:54 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 03 08:45:54 devstack cinder-volume[88796]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90223 Aug 03 08:45:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba9db8-8d43-4469-ad06-817925b9b4b4]: (2,) {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d533216-4221-4b47-af88-70b6ecd18603]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:45:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:54 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 Aug 03 08:45:54 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:55 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" returned: 0 in 1.070s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:55 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18 Aug 03 08:45:55 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:56 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "cinder-quobyte-2ccdfccc-a2f4-4e15-8419-f33ea577bd18" released by "delete_volume" :: held 3.730s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:56 devstack cinder-volume[88796]: WARNING cinder.quota [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:45:56 devstack cinder-volume[88796]: WARNING cinder.quota [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Created reservations ['8b488cda-985d-49e9-8d41-c7b3099ae197', 'ad4eb760-ce10-4272-b966-749c23b32334', 'ea0e0002-60c3-4d98-9792-04ca70de56c8', 'b3206c10-dc7e-46b7-b0c7-573a7f742d3a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:45:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:45:56 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:45:56 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:45:57 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Aug 03 08:45:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 1.071s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:45:57 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:45:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Deleted volume successfully. Aug 03 08:45:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a2f5c91-2b04-4c41-bee0-d1072d93210f tempest-VolumesAdminNegativeTest-1666725187 None] Lock "cinder-2ccdfccc-a2f4-4e15-8419-f33ea577bd18-delete_volume" released by "delete_volume" :: held 5.477s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:45:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-c52dfee7-4fd6-4b41-8ba3-eab346ed8d6e req-e097fb46-67e1-4b89-9b15-932a20375745 tempest-DeleteServersTestJSON-1001129580 None] Terminate volume connection completed successfully. Aug 03 08:45:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-c52dfee7-4fd6-4b41-8ba3-eab346ed8d6e req-e097fb46-67e1-4b89-9b15-932a20375745 tempest-DeleteServersTestJSON-1001129580 None] Deleting attachment a32436a2-2fa2-45dd-a7fa-423ee12d7d54. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "cinder-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "cinder-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "cinder-quobyte-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "cinder-quobyte-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa2f0f4-0f7a-46ab-8d91-50bf67324e00]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:00 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e Aug 03 08:46:00 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:00 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:00 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e Aug 03 08:46:00 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:01 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "cinder-quobyte-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e" released by "delete_volume" :: held 0.712s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Created reservations ['c383568a-2190-4a0b-acef-dd1c7186f342', '02262ce9-246a-4569-a326-32895f220497', 'ea9b4ac7-df4c-4258-b121-986356ac851f', '156b64e4-74fd-4e4f-97c5-22c4a01a4672'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:01 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:46:01 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:01 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Deleted volume successfully. Aug 03 08:46:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fab583d2-3249-4fa0-a89d-ba48beefd93d tempest-DeleteServersTestJSON-1001129580 None] Lock "cinder-b0fbc7ea-957b-46d6-9fb2-c6391b2dec1e-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:08 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:46:08 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:08 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.340s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 8 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:46:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:46:11 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=24 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:46:11 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=23,cinder:SELECT=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:46:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bcc0921-0294-404c-b80c-696376535a33 tempest-BackendsCapabilitiesAdminTestsJSON-544160718 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7364234924316, 'free_capacity_gb': 1775.7364234924316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88796) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 08:46:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fd7b0f05-4f74-4cd0-8015-b3006c67e3e2 tempest-BackendsCapabilitiesAdminTestsJSON-544160718 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7364234924316, 'free_capacity_gb': 1775.7364234924316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88796) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (f1d91fa5-0b7d-42d7-b4e9-ff7e4daee334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667e6b9-d942-4a25-9be0-1735ee12c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b667e6b9-d942-4a25-9be0-1735ee12c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1440870630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:21Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf25f6-1875-4d20-9479-0d7c1e32c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaf25f6-1875-4d20-9479-0d7c1e32c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fee08c-0b18-40e0-85c1-d06fac953c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4fee08c-0b18-40e0-85c1-d06fac953c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6', 'volume_name': 'volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c26f3a-ccbb-45d4-abf8-c76fa35aa72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c26f3a-ccbb-45d4-abf8-c76fa35aa72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8528f-e76b-4085-85b0-f4fe76e28e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Volume f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6', 'volume_size': 1} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1440870630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:21Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Creating volume f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:46:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:21 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 1073741824 Aug 03 08:46:21 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:22 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 1073741824" returned: 0 in 0.820s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:22 devstack sudo[90494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 Aug 03 08:46:22 devstack sudo[90494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:22 devstack sudo[90494]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" returned: 0 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8528f-e76b-4085-85b0-f4fe76e28e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7527b986-5792-486c-98c8-6e03f10ccb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Volume volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 (f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6): created successfully Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7527b986-5792-486c-98c8-6e03f10ccb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (f1d91fa5-0b7d-42d7-b4e9-ff7e4daee334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6318d5ed-abc4-4a65-b10c-ceb7b8017aa0 tempest-AttachVolumeTestJSON-268527428 None] Created volume successfully. Aug 03 08:46:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-17d4fc9f-a8e6-4ec7-96cc-ccc67904b3e4 req-e6985aad-0ba2-47a5-b305-f7c656b5344e tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-17d4fc9f-a8e6-4ec7-96cc-ccc67904b3e4 req-e6985aad-0ba2-47a5-b305-f7c656b5344e tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-17d4fc9f-a8e6-4ec7-96cc-ccc67904b3e4 req-e6985aad-0ba2-47a5-b305-f7c656b5344e tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-17d4fc9f-a8e6-4ec7-96cc-ccc67904b3e4 req-e6985aad-0ba2-47a5-b305-f7c656b5344e tempest-AttachVolumeTestJSON-268527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd10a2cf8-7df1-419f-b522-29ba73e74aa8', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:46:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-17d4fc9f-a8e6-4ec7-96cc-ccc67904b3e4 req-e6985aad-0ba2-47a5-b305-f7c656b5344e tempest-AttachVolumeTestJSON-268527428 None] attachment_update completed successfully. Aug 03 08:46:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-506d719d-2a7d-48a1-9dd1-4d08ea1b5235 tempest-GroupSnapshotsV319Test-1167275584 None] Group tempest-GroupSnapshotsV319Test-Group-61791681: creating Aug 03 08:46:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-506d719d-2a7d-48a1-9dd1-4d08ea1b5235 tempest-GroupSnapshotsV319Test-1167275584 None] Group tempest-GroupSnapshotsV319Test-Group-61791681: created successfully Aug 03 08:46:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-506d719d-2a7d-48a1-9dd1-4d08ea1b5235 tempest-GroupSnapshotsV319Test-1167275584 None] Create group completed successfully. Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Flow 'volume_create_manager' (c7571604-ccf0-4c76-80d3-de3eec4ace59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1a5221-1924-4e6c-8b02-eadbeee862df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1a5221-1924-4e6c-8b02-eadbeee862df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160530654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47c3d423-5892-492f-81dc-fd7b10255117,host='devstack@QuobyteHD#QuobyteHD',id=0606c296-bf2b-4cfb-b407-f1cf5e73d255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dbdd22ed3748e3b4d55e66ee894a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:30Z,use_quota=True,user_id='d3e0f8570d2744f882a32b4fb61187e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ee1a46-37d0-4a9a-986e-70ef0f4d4102),volume_type_id=57ee1a46-37d0-4a9a-986e-70ef0f4d4102)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3662d071-faa8-436a-ab1f-263981a79302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3662d071-faa8-436a-ab1f-263981a79302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e8b694-7180-48a3-bfca-5712f4ec6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e8b694-7180-48a3-bfca-5712f4ec6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0606c296-bf2b-4cfb-b407-f1cf5e73d255', 'volume_name': 'volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595eabb8-220e-4571-94bc-0546ad3367fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595eabb8-220e-4571-94bc-0546ad3367fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57159dcc-fefe-435b-8421-004fa1f317b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Volume 0606c296-bf2b-4cfb-b407-f1cf5e73d255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255', 'volume_size': 1} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47c3d423-5892-492f-81dc-fd7b10255117,created_at=2026-08-03T06:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1160530654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47c3d423-5892-492f-81dc-fd7b10255117,host='devstack@QuobyteHD#QuobyteHD',id=0606c296-bf2b-4cfb-b407-f1cf5e73d255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3dbdd22ed3748e3b4d55e66ee894a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:30Z,use_quota=True,user_id='d3e0f8570d2744f882a32b4fb61187e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57ee1a46-37d0-4a9a-986e-70ef0f4d4102),volume_type_id=57ee1a46-37d0-4a9a-986e-70ef0f4d4102)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Creating volume 0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:46:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:30 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 1073741824 Aug 03 08:46:30 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:31 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 1073741824" returned: 0 in 0.729s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:31 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 Aug 03 08:46:31 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:31 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57159dcc-fefe-435b-8421-004fa1f317b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975dacc6-277e-4bb6-b214-b9e4f992724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Volume volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 (0606c296-bf2b-4cfb-b407-f1cf5e73d255): created successfully Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975dacc6-277e-4bb6-b214-b9e4f992724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Flow 'volume_create_manager' (c7571604-ccf0-4c76-80d3-de3eec4ace59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b43858b3-6894-47eb-a7d6-06560f9184de tempest-GroupSnapshotsV319Test-1167275584 None] Created volume successfully. Aug 03 08:46:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] GroupSnapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: creating. Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Group snapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: creating. {{(pid=88796) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Creating offline snapshot fcabdc6f-776f-49f6-a243-18b8798fb3d4 of volume 0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[218027f3-72f8-483c-951d-a70065637548]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:34 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 Aug 03 08:46:34 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:34 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255" returned: 0 in 0.816s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:34 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 1G Aug 03 08:46:34 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:35 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 1G" returned: 0 in 0.789s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:35 devstack sudo[91485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 Aug 03 08:46:35 devstack sudo[91485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:35 devstack sudo[91485]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4" returned: 0 in 0.480s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:35 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:46:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:35 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 Aug 03 08:46:35 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:36 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:36 devstack sudo[91516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info Aug 03 08:46:36 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:36 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info" returned: 0 in 0.535s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:36 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:46:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:36 devstack sudo[91519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info Aug 03 08:46:36 devstack sudo[91519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:37 devstack sudo[91519]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.info" returned: 0 in 0.398s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.574s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e36f721b-561f-4db7-9b82-1b8107a47de9 tempest-GroupSnapshotsV319Test-1167275584 None] group_snapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: created successfully Aug 03 08:46:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] group_snapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: deleting Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] group_snapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: deleting {{(pid=88796) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "cinder-quobyte-fcabdc6f-776f-49f6-a243-18b8798fb3d4" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-fcabdc6f-776f-49f6-a243-18b8798fb3d4" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Deleting offline snapshot fcabdc6f-776f-49f6-a243-18b8798fb3d4 of volume 0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] snapshot_file for this snap is: volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5c5f9e-3c1f-457a-abd4-64bc807ed2cf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:39 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 Aug 03 08:46:39 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:39 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4" returned: 0 in 0.783s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2dfe6a-f591-4d33-be82-2a95303d2afb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:40 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 Aug 03 08:46:40 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:40 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255" returned: 0 in 0.705s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:40 devstack sudo[91566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 Aug 03 08:46:40 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:40 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:41 devstack sudo[91572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4 Aug 03 08:46:41 devstack sudo[91572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:41 devstack sudo[91572]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255.fcabdc6f-776f-49f6-a243-18b8798fb3d4" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-fcabdc6f-776f-49f6-a243-18b8798fb3d4" released by "_delete_snapshot" :: held 2.330s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" released by "delete_snapshot" :: held 2.376s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:41 devstack cinder-volume[88796]: WARNING cinder.quota [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-857593735 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-857593735, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:46:41 devstack cinder-volume[88796]: WARNING cinder.quota [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-857593735 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-857593735, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:46:41 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] Created reservations ['ba2270d7-c502-49a7-8b64-af3ba3ad83d3', 'b82fcf25-0321-4740-96c4-13984917b845', 'ba5d3b82-a406-45d3-999c-fda4c6a5df1f', '49524e9d-9636-4f4b-a8b9-f937acbbb186'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9ee3f02a-b48d-4b73-886a-159957189db8 tempest-GroupSnapshotsV319Test-1167275584 None] group_snapshot 60c65b04-1b97-4258-863b-793b4bb6c2c3: deleted successfully Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03cf4e1-bbb1-4427-ad24-bb03e9c67dd5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:42 devstack sudo[91575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 Aug 03 08:46:42 devstack sudo[91575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:42 devstack sudo[91575]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:42 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255 Aug 03 08:46:42 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:42 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0606c296-bf2b-4cfb-b407-f1cf5e73d255" returned: 0 in 0.411s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "cinder-quobyte-0606c296-bf2b-4cfb-b407-f1cf5e73d255" released by "delete_volume" :: held 0.885s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Created reservations ['7bc53bc0-2419-417a-83ac-886ee467ebef'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:43 devstack cinder-volume[88796]: WARNING cinder.quota [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-857593735 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-857593735, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Created reservations ['30e61ab7-c681-4fd9-bd72-5f932c6cb07e', 'e6e713a5-88c5-41b8-8f90-e40421acb898', '5aad4248-cddc-4cf8-8169-a6b89a6bd3ac', 'bbd4a9cc-f3c7-4bb0-8b80-6836d129574c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:43 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:46:43 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:43 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.368s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:43 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:46:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ab09f2c5-e6cf-4dc6-87b6-da9ce972f3f6 tempest-GroupSnapshotsV319Test-1167275584 None] Delete group completed successfully. Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Flow 'volume_create_manager' (ee7be2c4-92fb-4134-88b3-bbb70369c66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc95c5-fe78-40bb-b7ad-61199db01975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bc95c5-fe78-40bb-b7ad-61199db01975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1915633542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3d7bd1-212e-4da6-a004-ecfbb57a5222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adf531e14e341eebbb033a4fe47c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:49Z,use_quota=True,user_id='e8fc8c8606a94bc2ad94d556c7c41da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5551ccf2-8b91-4e55-8af5-f405191d9b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5551ccf2-8b91-4e55-8af5-f405191d9b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6a8393-7976-4b5e-a945-97756138f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6a8393-7976-4b5e-a945-97756138f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'volume_name': 'volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a1662a-e7a9-4ead-b689-fd81764248d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a1662a-e7a9-4ead-b689-fd81764248d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf7658f-c77c-48b1-89bf-0e317bcf0bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Volume 6d3d7bd1-212e-4da6-a004-ecfbb57a5222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'volume_size': 1} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1915633542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3d7bd1-212e-4da6-a004-ecfbb57a5222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adf531e14e341eebbb033a4fe47c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:46:49Z,use_quota=True,user_id='e8fc8c8606a94bc2ad94d556c7c41da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Creating volume 6d3d7bd1-212e-4da6-a004-ecfbb57a5222 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:46:49 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:46:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:49 devstack sudo[91597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 1073741824 Aug 03 08:46:49 devstack sudo[91597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:50 devstack sudo[91597]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 1073741824" returned: 0 in 0.895s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:46:50 devstack sudo[91608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 Aug 03 08:46:50 devstack sudo[91608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:46:51 devstack sudo[91608]: pam_unix(sudo:session): session closed for user root Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" returned: 0 in 0.528s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf7658f-c77c-48b1-89bf-0e317bcf0bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44454ae-0a04-4a7c-85bb-d9d7bc176379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:46:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Volume volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 (6d3d7bd1-212e-4da6-a004-ecfbb57a5222): created successfully Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e44454ae-0a04-4a7c-85bb-d9d7bc176379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:46:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Flow 'volume_create_manager' (ee7be2c4-92fb-4134-88b3-bbb70369c66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:46:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d5a7641b-4f85-4152-a85f-98c25e2668bf tempest-ServerActionsTestOtherA-1579685796 None] Created volume successfully. Aug 03 08:47:01 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=37,cinder:SELECT=39,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:01 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=32,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-46939652-ea61-4111-9d09-1a7b4d114ebe req-e617978a-f6fd-4903-b9f0-90807e154175 tempest-AttachVolumeTestJSON-268527428 None] Terminate volume connection completed successfully. Aug 03 08:47:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-46939652-ea61-4111-9d09-1a7b4d114ebe req-e617978a-f6fd-4903-b9f0-90807e154175 tempest-AttachVolumeTestJSON-268527428 None] Deleting attachment d10a2cf8-7df1-419f-b522-29ba73e74aa8. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:47:04 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Flow 'volume_create_manager' (2e874812-3039-4a5d-b356-07947b5e8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117eebe-506a-4803-9543-b6b70f3301a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f117eebe-506a-4803-9543-b6b70f3301a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1296022113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0433939-a2eb-4a3a-9796-d9145e920142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddb9c1195fa484d84ea7ef6e3586ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:05Z,use_quota=True,user_id='35a7b5bb60124faa9d72e2151d436ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b84ff-3704-45a5-8377-22be280da5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042b84ff-3704-45a5-8377-22be280da5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c54d00-ae08-4995-ae34-a4884c6dac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c54d00-ae08-4995-ae34-a4884c6dac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0433939-a2eb-4a3a-9796-d9145e920142', 'volume_name': 'volume-d0433939-a2eb-4a3a-9796-d9145e920142', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84b391f-8806-47d5-9c38-425ca334999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84b391f-8806-47d5-9c38-425ca334999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6daca0e-4ce5-412c-b7c6-ee894458aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:05 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Volume d0433939-a2eb-4a3a-9796-d9145e920142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0433939-a2eb-4a3a-9796-d9145e920142', 'volume_size': 1} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1296022113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0433939-a2eb-4a3a-9796-d9145e920142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddb9c1195fa484d84ea7ef6e3586ff3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:05Z,use_quota=True,user_id='35a7b5bb60124faa9d72e2151d436ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Creating volume d0433939-a2eb-4a3a-9796-d9145e920142 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:05 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:05 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 1073741824 Aug 03 08:47:05 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:05 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 1073741824" returned: 0 in 0.802s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:05 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 Aug 03 08:47:05 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:06 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6daca0e-4ce5-412c-b7c6-ee894458aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0433939-a2eb-4a3a-9796-d9145e920142', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323533ff-8c62-45c8-bb4b-9c78b00947e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:06 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Volume volume-d0433939-a2eb-4a3a-9796-d9145e920142 (d0433939-a2eb-4a3a-9796-d9145e920142): created successfully Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323533ff-8c62-45c8-bb4b-9c78b00947e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Flow 'volume_create_manager' (2e874812-3039-4a5d-b356-07947b5e8479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:06 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8fc4e971-f7b3-488b-b855-33ac70180847 tempest-TaggedAttachmentsTest-411094816 None] Created volume successfully. Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:08 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:47:08 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:09 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.644s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:47:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 8 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:47:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:47:16 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:16 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Flow 'volume_create_manager' (3b935819-7687-4dc5-8bca-0e436fe3afde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc8ff5-e939-4a05-a975-8d9313592a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecdc8ff5-e939-4a05-a975-8d9313592a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1752899950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a7f995-ccae-4249-97fa-d1a41cce9d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7f574760c548e499266416f71f2ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:22Z,use_quota=True,user_id='20648664fb5449f9b4d53eb779c74d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffb8bbb-80c6-4446-a7ec-2ac22047fd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ffb8bbb-80c6-4446-a7ec-2ac22047fd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c21ea0-9671-4d5c-a46d-2b2109ed51c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c21ea0-9671-4d5c-a46d-2b2109ed51c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a7f995-ccae-4249-97fa-d1a41cce9d4e', 'volume_name': 'volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d706e649-0851-437c-a873-de8045994427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d706e649-0851-437c-a873-de8045994427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b0bc5-b553-4cad-b151-24a77d3c92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume 80a7f995-ccae-4249-97fa-d1a41cce9d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e', 'volume_size': 1} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1752899950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a7f995-ccae-4249-97fa-d1a41cce9d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7f574760c548e499266416f71f2ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:22Z,use_quota=True,user_id='20648664fb5449f9b4d53eb779c74d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Creating volume 80a7f995-ccae-4249-97fa-d1a41cce9d4e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:47:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:21 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e 1073741824 Aug 03 08:47:21 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:22 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e 1073741824" returned: 0 in 0.483s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:22 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e Aug 03 08:47:22 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:22 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4b0bc5-b553-4cad-b151-24a77d3c92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355a17bf-35bc-4f19-a767-9c152b20c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e (80a7f995-ccae-4249-97fa-d1a41cce9d4e): created successfully Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355a17bf-35bc-4f19-a767-9c152b20c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Flow 'volume_create_manager' (3b935819-7687-4dc5-8bca-0e436fe3afde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-21737202-e987-4347-962c-6f92d2496f0d tempest-VolumeQuotasAdminTestJSON-300388874 None] Created volume successfully. Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "cinder-80a7f995-ccae-4249-97fa-d1a41cce9d4e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "cinder-80a7f995-ccae-4249-97fa-d1a41cce9d4e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "cinder-quobyte-80a7f995-ccae-4249-97fa-d1a41cce9d4e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "cinder-quobyte-80a7f995-ccae-4249-97fa-d1a41cce9d4e" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc3cbfe-fc02-4e61-ab96-42eb904131b1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:24 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e Aug 03 08:47:24 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:24 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e" returned: 0 in 0.568s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:24 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e Aug 03 08:47:24 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:24 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80a7f995-ccae-4249-97fa-d1a41cce9d4e" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "cinder-quobyte-80a7f995-ccae-4249-97fa-d1a41cce9d4e" released by "delete_volume" :: held 1.061s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Created reservations ['2caba228-1318-4a3e-a72d-dca2c8fa50e8', 'e24d32d2-c989-4c11-baed-ea2993aa46a6', 'f15aa4ec-11ee-4174-9f1a-9e9e4246e498', 'e8f52482-f604-44da-b2b7-4874546f5b23'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:25 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:47:25 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:25 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Deleted volume successfully. Aug 03 08:47:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27e5da10-0a1c-47f2-8edf-d8a3f579e307 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "cinder-80a7f995-ccae-4249-97fa-d1a41cce9d4e-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Flow 'volume_create_manager' (56df3036-c308-4aaf-8989-f1dabb5a3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683fff1c-be00-426a-a03a-7ea5ecc9d0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683fff1c-be00-426a-a03a-7ea5ecc9d0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-350480019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0601b-23b3-4fdc-a479-8f2a7884e5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7f574760c548e499266416f71f2ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:27Z,use_quota=True,user_id='20648664fb5449f9b4d53eb779c74d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549d0a8-d3ee-4589-a26f-896cf3d8e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549d0a8-d3ee-4589-a26f-896cf3d8e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217ee05b-1316-4433-96c2-ece7d9f9b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217ee05b-1316-4433-96c2-ece7d9f9b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c0601b-23b3-4fdc-a479-8f2a7884e5bc', 'volume_name': 'volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ae015-822b-408b-b664-f1ef1b2f4b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (575ae015-822b-408b-b664-f1ef1b2f4b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a5412b-e2fb-4889-be97-a0929a3339af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume c8c0601b-23b3-4fdc-a479-8f2a7884e5bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc', 'volume_size': 1} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-350480019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0601b-23b3-4fdc-a479-8f2a7884e5bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f7f574760c548e499266416f71f2ed5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:27Z,use_quota=True,user_id='20648664fb5449f9b4d53eb779c74d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Creating volume c8c0601b-23b3-4fdc-a479-8f2a7884e5bc {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:27 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc 1073741824 Aug 03 08:47:27 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:27 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc 1073741824" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:27 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc Aug 03 08:47:27 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:27 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a5412b-e2fb-4889-be97-a0929a3339af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4731b165-ef2a-4543-86c0-720f7d5298b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Volume volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc (c8c0601b-23b3-4fdc-a479-8f2a7884e5bc): created successfully Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4731b165-ef2a-4543-86c0-720f7d5298b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Flow 'volume_create_manager' (56df3036-c308-4aaf-8989-f1dabb5a3145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f065ff16-2c4c-4538-853e-95987e3ed952 tempest-VolumeQuotasAdminTestJSON-300388874 None] Created volume successfully. Aug 03 08:47:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-68a16b15-5ceb-4066-a0c0-a4d6713f9668 tempest-VolumeQuotasAdminTestJSON-1983468838 None] Transfer volume completed successfully. Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f79c535b-8219-4404-b6ca-a5322f2fddd2 req-18c50374-9cef-469b-9401-728488c8832e tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f79c535b-8219-4404-b6ca-a5322f2fddd2 req-18c50374-9cef-469b-9401-728488c8832e tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f79c535b-8219-4404-b6ca-a5322f2fddd2 req-18c50374-9cef-469b-9401-728488c8832e tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f79c535b-8219-4404-b6ca-a5322f2fddd2 req-18c50374-9cef-469b-9401-728488c8832e tempest-ServerActionsTestOtherA-1579685796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e77d350-0065-4b69-a9aa-ab4175ff27bf', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Acquiring lock "cinder-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "cinder-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f79c535b-8219-4404-b6ca-a5322f2fddd2 req-18c50374-9cef-469b-9401-728488c8832e tempest-ServerActionsTestOtherA-1579685796 None] attachment_update completed successfully. Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Acquiring lock "cinder-quobyte-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "cinder-quobyte-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0e8a1b-1a35-46af-8a6d-9a6618bf88a8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:47:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:31 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc Aug 03 08:47:31 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:31 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" returned: 0 in 0.463s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:31 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc Aug 03 08:47:31 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:31 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "cinder-quobyte-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc" released by "delete_volume" :: held 0.813s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Created reservations ['b87f9ddf-4cad-4457-b898-fa8c8312ecd8', '48c815bf-6197-47ee-b339-f8b08cc37530', '2d0b9793-4664-4a20-a47f-27bfd1525094', 'f26ef337-868f-451e-b6a4-22dce3a0eb4a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:31 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:47:31 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:32 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:32 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:47:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Deleted volume successfully. Aug 03 08:47:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-67fec6e9-cdfd-48b6-a1bb-cd16f011913e tempest-VolumeQuotasAdminTestJSON-1050815739 None] Lock "cinder-c8c0601b-23b3-4fdc-a479-8f2a7884e5bc-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:47:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-5d61bed5-332f-43f3-9bfa-9367204fb878 tempest-ServerActionsTestOtherA-1579685796 None] Terminate volume connection completed successfully. Aug 03 08:47:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-5d61bed5-332f-43f3-9bfa-9367204fb878 tempest-ServerActionsTestOtherA-1579685796 None] Deleting attachment 9e77d350-0065-4b69-a9aa-ab4175ff27bf. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:47:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-b96e4aa9-e9b8-4ee1-ab9f-212032ec3a08 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-b96e4aa9-e9b8-4ee1-ab9f-212032ec3a08 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-b96e4aa9-e9b8-4ee1-ab9f-212032ec3a08 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-b96e4aa9-e9b8-4ee1-ab9f-212032ec3a08 tempest-ServerActionsTestOtherA-1579685796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5729162-facc-4e41-b79e-02013525a9d0', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:47:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-de3e454a-1ebc-4b75-a813-6b7c47567338 req-b96e4aa9-e9b8-4ee1-ab9f-212032ec3a08 tempest-ServerActionsTestOtherA-1579685796 None] attachment_update completed successfully. Aug 03 08:47:46 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:46 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=24,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Flow 'volume_create_manager' (2edffdf9-8bec-4683-8d8b-fe09411819c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661b06c-08a6-4d5d-848d-f0abefbbc2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661b06c-08a6-4d5d-848d-f0abefbbc2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2063953905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18ac49-73f7-4a3e-9dda-75f52c895852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1c082dd435442c80db670c024fd25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:54Z,use_quota=True,user_id='ad6f7e43c4e64011aef5d3af680feff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858e4c2e-2091-4676-afc5-d27db66898ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858e4c2e-2091-4676-afc5-d27db66898ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae91cefc-4919-42e2-9910-6917f9080c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae91cefc-4919-42e2-9910-6917f9080c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e18ac49-73f7-4a3e-9dda-75f52c895852', 'volume_name': 'volume-4e18ac49-73f7-4a3e-9dda-75f52c895852', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b71eba-0a3d-47f4-9c72-cc8513c9af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b71eba-0a3d-47f4-9c72-cc8513c9af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31d6195-a82a-4daf-8b56-53c6ecd6803a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Volume 4e18ac49-73f7-4a3e-9dda-75f52c895852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e18ac49-73f7-4a3e-9dda-75f52c895852', 'volume_size': 1} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2063953905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e18ac49-73f7-4a3e-9dda-75f52c895852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1c082dd435442c80db670c024fd25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:47:54Z,use_quota=True,user_id='ad6f7e43c4e64011aef5d3af680feff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Creating volume 4e18ac49-73f7-4a3e-9dda-75f52c895852 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:47:54 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:47:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:54 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 1073741824 Aug 03 08:47:54 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:55 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 1073741824" returned: 0 in 0.853s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:47:55 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 Aug 03 08:47:55 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:47:56 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31d6195-a82a-4daf-8b56-53c6ecd6803a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e18ac49-73f7-4a3e-9dda-75f52c895852', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6282d7-65c3-4b6c-8b0d-e3a257a426e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:47:56 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Volume volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 (4e18ac49-73f7-4a3e-9dda-75f52c895852): created successfully Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6282d7-65c3-4b6c-8b0d-e3a257a426e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:47:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Flow 'volume_create_manager' (2edffdf9-8bec-4683-8d8b-fe09411819c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:47:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f1ea513c-24b2-4f64-95a8-4622ea913295 tempest-VolumesNegativeTest-317212263 None] Created volume successfully. Aug 03 08:47:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-ab93893d-d814-4fc5-8b14-f193f4ee6136 req-ec1ee714-ef81-4314-80d3-f670ef555e0f tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:47:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-ab93893d-d814-4fc5-8b14-f193f4ee6136 req-ec1ee714-ef81-4314-80d3-f670ef555e0f tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:47:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-ab93893d-d814-4fc5-8b14-f193f4ee6136 req-ec1ee714-ef81-4314-80d3-f670ef555e0f tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:47:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-ab93893d-d814-4fc5-8b14-f193f4ee6136 req-ec1ee714-ef81-4314-80d3-f670ef555e0f tempest-TaggedAttachmentsTest-411094816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-d0433939-a2eb-4a3a-9796-d9145e920142', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4bfcd9d-561e-4793-bf4d-374fb39607c2', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:47:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-ab93893d-d814-4fc5-8b14-f193f4ee6136 req-ec1ee714-ef81-4314-80d3-f670ef555e0f tempest-TaggedAttachmentsTest-411094816 None] attachment_update completed successfully. Aug 03 08:48:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-99567c6e-8671-4fe7-9f34-f8bcdc0c9a3c req-5c6910b2-aa43-4327-86d2-6dd49d6d2261 tempest-TaggedAttachmentsTest-411094816 None] Terminate volume connection completed successfully. Aug 03 08:48:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-99567c6e-8671-4fe7-9f34-f8bcdc0c9a3c req-5c6910b2-aa43-4327-86d2-6dd49d6d2261 tempest-TaggedAttachmentsTest-411094816 None] Deleting attachment c4bfcd9d-561e-4793-bf4d-374fb39607c2. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-45f94c8d-3713-4bd7-b132-fd473fbe219f req-c8ec7bb9-2829-4178-aab2-f7a91e61e2c8 tempest-ServerActionsTestOtherA-1579685796 None] Terminate volume connection completed successfully. Aug 03 08:48:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-45f94c8d-3713-4bd7-b132-fd473fbe219f req-c8ec7bb9-2829-4178-aab2-f7a91e61e2c8 tempest-ServerActionsTestOtherA-1579685796 None] Deleting attachment b5729162-facc-4e41-b79e-02013525a9d0. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:08 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:48:08 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:09 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.842s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:48:17 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:48:17 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "cinder-d0433939-a2eb-4a3a-9796-d9145e920142-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "cinder-d0433939-a2eb-4a3a-9796-d9145e920142-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "cinder-quobyte-d0433939-a2eb-4a3a-9796-d9145e920142" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "cinder-quobyte-d0433939-a2eb-4a3a-9796-d9145e920142" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97febe-1917-4ad8-b18c-083f4bcd4528]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:20 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 Aug 03 08:48:20 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Flow 'volume_create_manager' (b8c46cc7-97d1-48f8-8c17-8df6fafca94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7135ebd1-800d-4c4b-ae5b-e848e33a4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7135ebd1-800d-4c4b-ae5b-e848e33a4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-38460962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca302a7-965a-4955-9fbf-e79aff4d91cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adf531e14e341eebbb033a4fe47c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:21Z,use_quota=True,user_id='e8fc8c8606a94bc2ad94d556c7c41da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc3af8-64ee-470a-9b39-f5033897201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eecc3af8-64ee-470a-9b39-f5033897201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea7f152-ec59-483d-8a5d-0f672347c090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:20 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:48:21 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142" returned: 0 in 0.781s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:21 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142 Aug 03 08:48:21 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea7f152-ec59-483d-8a5d-0f672347c090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dca302a7-965a-4955-9fbf-e79aff4d91cd', 'volume_name': 'volume-dca302a7-965a-4955-9fbf-e79aff4d91cd', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ad4fd7-5ca1-4197-843e-06bd236eb33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ad4fd7-5ca1-4197-843e-06bd236eb33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4d9944-4ae9-4689-a762-61a62593e4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Volume dca302a7-965a-4955-9fbf-e79aff4d91cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dca302a7-965a-4955-9fbf-e79aff4d91cd', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Trying to clone dca302a7-965a-4955-9fbf-e79aff4d91cd from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:48:21 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0433939-a2eb-4a3a-9796-d9145e920142" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "cinder-quobyte-d0433939-a2eb-4a3a-9796-d9145e920142" released by "delete_volume" :: held 1.248s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Created reservations ['16896dc8-2a2a-4bfc-9a2f-9e65ba957fae', '1edfd747-e442-428e-b15d-147885668878', 'ba5739b4-1c13-4640-be9e-87838e1c616b', 'e5da68ec-57f1-4ed4-89de-bca25c4294a4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:21 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:48:21 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:21 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:48:21 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589e91f-92d4-4be3-a448-5384cd38de1c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:22 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.333s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:48:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Deleted volume successfully. Aug 03 08:48:22 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD Aug 03 08:48:22 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bfc67e95-1d2b-47a2-9c7b-abe82f8f0623 tempest-TaggedAttachmentsTest-411094816 None] Lock "cinder-d0433939-a2eb-4a3a-9796-d9145e920142-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:22 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user e8fc8c8606a94bc2ad94d556c7c41da4. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfc6d5-f377-42a3-836f-535a39802a4c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:22 devstack sudo[93658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD Aug 03 08:48:22 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:23 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-38460962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dca302a7-965a-4955-9fbf-e79aff4d91cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3adf531e14e341eebbb033a4fe47c60e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:21Z,use_quota=True,user_id='e8fc8c8606a94bc2ad94d556c7c41da4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Creating volume dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:48:23 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:23 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1073741824 Aug 03 08:48:23 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:23 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1073741824" returned: 0 in 0.686s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:23 devstack sudo[93670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd Aug 03 08:48:23 devstack sudo[93670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:24 devstack sudo[93670]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume dca302a7-965a-4955-9fbf-e79aff4d91cd. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[417c29bb-6600-4389-bbf9-7c6b94abbeae]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:24 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek Aug 03 08:48:24 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:24 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek" returned: 0 in 0.403s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:24 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek Aug 03 08:48:24 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:25 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek" returned: 1 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_t03yysek' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb37c7b-1bf5-4394-bd39-b533c2d36beb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:25 devstack sudo[93715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD Aug 03 08:48:25 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:25 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:48:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:25 devstack sudo[93721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd Aug 03 08:48:25 devstack sudo[93721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Acquiring lock "cinder-4e18ac49-73f7-4a3e-9dda-75f52c895852-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "cinder-4e18ac49-73f7-4a3e-9dda-75f52c895852-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Acquiring lock "cinder-quobyte-4e18ac49-73f7-4a3e-9dda-75f52c895852" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "cinder-quobyte-4e18ac49-73f7-4a3e-9dda-75f52c895852" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dfcedb-385b-40f9-9d27-c8e0c9d0333c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:27 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 Aug 03 08:48:27 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:27 devstack sudo[93721]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd" returned: 0 in 2.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_8gx8m6fndevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:48:27 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Converted 112.00 MB image at 48.98 MB/s Aug 03 08:48:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:28 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1G Aug 03 08:48:28 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:28 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852" returned: 0 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:28 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852 Aug 03 08:48:28 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:28 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd 1G" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume dca302a7-965a-4955-9fbf-e79aff4d91cd successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user e8fc8c8606a94bc2ad94d556c7c41da4 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Marking volume dca302a7-965a-4955-9fbf-e79aff4d91cd as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to dca302a7-965a-4955-9fbf-e79aff4d91cd. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Creating volume glance metadata for volume dca302a7-965a-4955-9fbf-e79aff4d91cd backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b4d9944-4ae9-4689-a762-61a62593e4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dca302a7-965a-4955-9fbf-e79aff4d91cd', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116d5b66-fb40-410d-830f-689a56a0508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Volume volume-dca302a7-965a-4955-9fbf-e79aff4d91cd (dca302a7-965a-4955-9fbf-e79aff4d91cd): created successfully Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116d5b66-fb40-410d-830f-689a56a0508a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Flow 'volume_create_manager' (b8c46cc7-97d1-48f8-8c17-8df6fafca94d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:28 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4e18ac49-73f7-4a3e-9dda-75f52c895852" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "cinder-quobyte-4e18ac49-73f7-4a3e-9dda-75f52c895852" released by "delete_volume" :: held 0.782s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8e06ee05-203c-45d4-8388-15536cf90783 tempest-ServerActionsTestOtherA-1579685796 None] Created volume successfully. Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Created reservations ['a2aecd66-a435-4168-aa5b-56a41d023736', '2852356b-b94e-40b2-bd31-64f01860e385', 'b67b3fcb-72ff-49b3-a683-af76d8f1d452', 'b3f80b51-02d4-4bc2-9c1f-3152258f6c11'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:28 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:48:28 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:28 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:28 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:48:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Deleted volume successfully. Aug 03 08:48:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b3425b0-ca12-41a3-803c-945aac8b8d1f tempest-VolumesNegativeTest-317212263 None] Lock "cinder-4e18ac49-73f7-4a3e-9dda-75f52c895852-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Flow 'volume_create_manager' (78b07d39-e8dc-4c0a-9d44-09191491f77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dde43a-8fbc-47b5-909b-d39ccf286036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57dde43a-8fbc-47b5-909b-d39ccf286036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1074136816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bae39d2-ad0b-4370-bd69-00acd1f367f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baca7932800345b18df0d43129ead66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:33Z,use_quota=True,user_id='1fbbd79cfafb4f6fbdf9046759520f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f229ae-ec4f-4d31-be70-629f9c95292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f229ae-ec4f-4d31-be70-629f9c95292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc5e691-7931-4aa1-9661-1f0db6ae08ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc5e691-7931-4aa1-9661-1f0db6ae08ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bae39d2-ad0b-4370-bd69-00acd1f367f2', 'volume_name': 'volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d57e5f-7cc9-441e-8ac2-d1f0a90cf6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15d57e5f-7cc9-441e-8ac2-d1f0a90cf6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6021c6ed-1ddb-4e60-9bd0-a1f665406b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2', 'volume_size': 1} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1074136816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bae39d2-ad0b-4370-bd69-00acd1f367f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baca7932800345b18df0d43129ead66d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:33Z,use_quota=True,user_id='1fbbd79cfafb4f6fbdf9046759520f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Creating volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:48:32 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:48:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:32 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 1073741824 Aug 03 08:48:32 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-43865336-8917-48a1-9199-8fca486a0616 req-18bc7d9c-e901-4df4-a4c6-c241d08fe26f tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:33 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 1073741824" returned: 0 in 0.725s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:33 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 Aug 03 08:48:33 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:33 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-43865336-8917-48a1-9199-8fca486a0616 req-18bc7d9c-e901-4df4-a4c6-c241d08fe26f tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.396s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6021c6ed-1ddb-4e60-9bd0-a1f665406b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c504d8a8-6a31-4f4f-b7af-af49877d4ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-43865336-8917-48a1-9199-8fca486a0616 req-18bc7d9c-e901-4df4-a4c6-c241d08fe26f tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Volume volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 (4bae39d2-ad0b-4370-bd69-00acd1f367f2): created successfully Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c504d8a8-6a31-4f4f-b7af-af49877d4ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Flow 'volume_create_manager' (78b07d39-e8dc-4c0a-9d44-09191491f77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0a5667f2-384c-4aaa-8325-0886235f4891 tempest-VolumesSnapshotListTestJSON-1687622476 None] Created volume successfully. Aug 03 08:48:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-43865336-8917-48a1-9199-8fca486a0616 req-18bc7d9c-e901-4df4-a4c6-c241d08fe26f tempest-ServerActionsTestOtherA-1579685796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-dca302a7-965a-4955-9fbf-e79aff4d91cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'df72b95e-9814-4b76-86e3-e530ef980925', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:48:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-43865336-8917-48a1-9199-8fca486a0616 req-18bc7d9c-e901-4df4-a4c6-c241d08fe26f tempest-ServerActionsTestOtherA-1579685796 None] attachment_update completed successfully. Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Creating offline snapshot 37daf55f-b401-48e1-90b8-1e40bf13f1fd of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a805bc2c-cc52-4c2e-a270-9ab2604cfd07]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:35 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 Aug 03 08:48:35 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:35 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:35 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd 1G Aug 03 08:48:35 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:36 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd 1G" returned: 0 in 0.479s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:36 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:48:36 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:36 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:36 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd is being set with open permissions: ugo+rw Aug 03 08:48:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:36 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:48:36 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:36 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.508s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:37 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info Aug 03 08:48:37 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:37 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:37 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info is being set with open permissions: ugo+rw Aug 03 08:48:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:37 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info Aug 03 08:48:37 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:37 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.info" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-96f4854b-9920-4d59-967b-6b86a3f3def1 tempest-VolumesSnapshotListTestJSON-1687622476 None] Create snapshot completed successfully Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (1132cc7e-b69c-4ced-96cb-f89eaa5ec869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb63d1-2ddb-4cd6-b282-23fb9c51f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecb63d1-2ddb-4cd6-b282-23fb9c51f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1729602962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3bc03b-6630-4126-8162-50d6d4595ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:38Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28555f6-eb5a-41f9-8e93-b7c116c96082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28555f6-eb5a-41f9-8e93-b7c116c96082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d316b5-4ff0-4aeb-9823-430842fa0b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7d316b5-4ff0-4aeb-9823-430842fa0b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3bc03b-6630-4126-8162-50d6d4595ab4', 'volume_name': 'volume-fd3bc03b-6630-4126-8162-50d6d4595ab4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134bb357-183c-495b-8591-46183a585bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134bb357-183c-495b-8591-46183a585bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f7d7bf-ffcb-4961-ba8f-221747592614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:38 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Volume fd3bc03b-6630-4126-8162-50d6d4595ab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3bc03b-6630-4126-8162-50d6d4595ab4', 'volume_size': 1} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1729602962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd3bc03b-6630-4126-8162-50d6d4595ab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:38Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Creating volume fd3bc03b-6630-4126-8162-50d6d4595ab4 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:48:38 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:38 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 1073741824 Aug 03 08:48:38 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:39 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 1073741824" returned: 0 in 0.607s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:39 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 Aug 03 08:48:39 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:39 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.868s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f7d7bf-ffcb-4961-ba8f-221747592614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3bc03b-6630-4126-8162-50d6d4595ab4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94db52d-5d78-4b9f-99a8-0ab09f12fe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Creating offline snapshot 8ec3abff-1a6c-466d-893b-90255c5901b5 of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:48:39 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Volume volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 (fd3bc03b-6630-4126-8162-50d6d4595ab4): created successfully Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a94db52d-5d78-4b9f-99a8-0ab09f12fe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (1132cc7e-b69c-4ced-96cb-f89eaa5ec869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f940a08-88be-4cdc-93ed-012febd6d4e3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3474a99a-49ac-46a4-982b-37d17e879dc5 tempest-AttachVolumeTestJSON-268527428 None] Created volume successfully. Aug 03 08:48:39 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:48:39 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:40 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.573s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:40 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 1G Aug 03 08:48:40 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:40 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 1G" returned: 0 in 0.837s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:40 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:40 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:41 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.589s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:41 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 is being set with open permissions: ugo+rw Aug 03 08:48:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:41 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:41 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4f8bd3e3-5349-41b7-a12e-3f1d8a0cba04 req-bb5ed2cd-2674-41e6-9fca-a5e8108a44da tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:42 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.562s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4f8bd3e3-5349-41b7-a12e-3f1d8a0cba04 req-bb5ed2cd-2674-41e6-9fca-a5e8108a44da tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.156s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4f8bd3e3-5349-41b7-a12e-3f1d8a0cba04 req-bb5ed2cd-2674-41e6-9fca-a5e8108a44da tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-4f8bd3e3-5349-41b7-a12e-3f1d8a0cba04 req-bb5ed2cd-2674-41e6-9fca-a5e8108a44da tempest-AttachVolumeTestJSON-268527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-fd3bc03b-6630-4126-8162-50d6d4595ab4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f192e7ce-32db-4131-8e18-ccce48c9e6e9', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:48:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6954f269-10d6-4c57-903c-5655c81664f3 tempest-VolumesSnapshotListTestJSON-1687622476 None] Create snapshot completed successfully Aug 03 08:48:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-4f8bd3e3-5349-41b7-a12e-3f1d8a0cba04 req-bb5ed2cd-2674-41e6-9fca-a5e8108a44da tempest-AttachVolumeTestJSON-268527428 None] attachment_update completed successfully. Aug 03 08:48:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Creating offline snapshot beaa4921-00b9-495a-9739-8b24f20fd49e of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:48:43 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db969f-b764-4f0a-b4c1-8078765f80a4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:43 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:43 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:44 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.783s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:44 devstack sudo[94340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e 1G Aug 03 08:48:44 devstack sudo[94340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:45 devstack sudo[94340]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e 1G" returned: 0 in 0.877s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:45 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e Aug 03 08:48:45 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:46 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e" returned: 0 in 1.010s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:46 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e is being set with open permissions: ugo+rw Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:46 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e Aug 03 08:48:46 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (cb0dbd51-4144-41ca-bb36-eb8f4ea434e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9955bfcf-5c4c-477e-8530-5bba3ef52758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9955bfcf-5c4c-477e-8530-5bba3ef52758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1658133920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75027d20-e752-4076-b0d3-e1f2fb447465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:46Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dc2c4a-9c20-4a45-9cfe-3c8e85eec285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37dc2c4a-9c20-4a45-9cfe-3c8e85eec285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93265540-569d-4559-9e47-8748ff24b348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93265540-569d-4559-9e47-8748ff24b348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75027d20-e752-4076-b0d3-e1f2fb447465', 'volume_name': 'volume-75027d20-e752-4076-b0d3-e1f2fb447465', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd932c21-2583-479f-976e-1f6b4c03e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd932c21-2583-479f-976e-1f6b4c03e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff6ba2e-2842-4971-97e5-043cca2f2b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Volume 75027d20-e752-4076-b0d3-e1f2fb447465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75027d20-e752-4076-b0d3-e1f2fb447465', 'volume_size': 1} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:46 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e" returned: 0 in 0.549s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.390s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1658133920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75027d20-e752-4076-b0d3-e1f2fb447465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5403ec6dba354fea9887e4485ed43777',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:48:46Z,use_quota=True,user_id='0b9aeed422d14880b563a131938b5168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Creating volume 75027d20-e752-4076-b0d3-e1f2fb447465 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:48:46 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:48:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:46 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 1073741824 Aug 03 08:48:46 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-46dea8f6-4129-4a3a-9e87-746cda79aa67 tempest-VolumesSnapshotListTestJSON-1687622476 None] Create snapshot completed successfully Aug 03 08:48:47 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 1073741824" returned: 0 in 0.883s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:47 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 Aug 03 08:48:47 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:48 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff6ba2e-2842-4971-97e5-043cca2f2b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75027d20-e752-4076-b0d3-e1f2fb447465', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c46c97-85ac-4662-8655-bceb99c136ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:48:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Volume volume-75027d20-e752-4076-b0d3-e1f2fb447465 (75027d20-e752-4076-b0d3-e1f2fb447465): created successfully Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c46c97-85ac-4662-8655-bceb99c136ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:48:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Flow 'volume_create_manager' (cb0dbd51-4144-41ca-bb36-eb8f4ea434e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:48:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-eb5b00a4-fa95-4cab-b3ff-f2466c94c98b tempest-AttachVolumeTestJSON-268527428 None] Created volume successfully. Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-beaa4921-00b9-495a-9739-8b24f20fd49e-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-beaa4921-00b9-495a-9739-8b24f20fd49e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-beaa4921-00b9-495a-9739-8b24f20fd49e" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-beaa4921-00b9-495a-9739-8b24f20fd49e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Deleting offline snapshot beaa4921-00b9-495a-9739-8b24f20fd49e of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] snapshot_file for this snap is: volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca91314-9961-4c23-8838-49566b81bb1b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:49 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e Aug 03 08:48:49 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:50 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e" returned: 0 in 1.111s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ba6b07-65d1-4f4b-9ac3-94418acc04f9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9ba18f5c-cfca-44f9-ab6f-1061164663e7 req-6a0c1489-46af-4cf5-8548-aec461e5d83d tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9ba18f5c-cfca-44f9-ab6f-1061164663e7 req-6a0c1489-46af-4cf5-8548-aec461e5d83d tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9ba18f5c-cfca-44f9-ab6f-1061164663e7 req-6a0c1489-46af-4cf5-8548-aec461e5d83d tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-9ba18f5c-cfca-44f9-ab6f-1061164663e7 req-6a0c1489-46af-4cf5-8548-aec461e5d83d tempest-AttachVolumeTestJSON-268527428 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-75027d20-e752-4076-b0d3-e1f2fb447465', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '356711e6-a4f1-474d-af93-d69f425e2837', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:48:51 devstack sudo[94393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:51 devstack sudo[94393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-9ba18f5c-cfca-44f9-ab6f-1061164663e7 req-6a0c1489-46af-4cf5-8548-aec461e5d83d tempest-AttachVolumeTestJSON-268527428 None] attachment_update completed successfully. Aug 03 08:48:51 devstack sudo[94393]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 1.172s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:52 devstack sudo[94404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e Aug 03 08:48:52 devstack sudo[94404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:53 devstack sudo[94404]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e" returned: 0 in 1.213s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:53 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e Aug 03 08:48:53 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:53 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.beaa4921-00b9-495a-9739-8b24f20fd49e" returned: 0 in 0.496s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-beaa4921-00b9-495a-9739-8b24f20fd49e" released by "_delete_snapshot" :: held 4.277s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" released by "delete_snapshot" :: held 4.320s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:53 devstack cinder-volume[88796]: WARNING cinder.quota [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:48:53 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Created reservations ['3f3146ff-24ae-4d03-b10e-c811abaa65c9', 'ae1af668-f3e4-4570-8697-a2270e899d9f', 'fb3513da-f511-4e6c-b172-a85107e3fcf4', '198b3bcf-c1bc-48b8-bc9f-91cee0d4745c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:48:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Delete snapshot completed successfully. Aug 03 08:48:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38017729-9250-4027-ae23-bec1fed64528 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-beaa4921-00b9-495a-9739-8b24f20fd49e-delete_snapshot" released by "delete_snapshot" :: held 4.604s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-8ec3abff-1a6c-466d-893b-90255c5901b5-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-8ec3abff-1a6c-466d-893b-90255c5901b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-8ec3abff-1a6c-466d-893b-90255c5901b5" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-8ec3abff-1a6c-466d-893b-90255c5901b5" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Deleting offline snapshot 8ec3abff-1a6c-466d-893b-90255c5901b5 of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] snapshot_file for this snap is: volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a122ea-29b6-428c-bf9b-d7e4e6406041]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-f3b6de57-9d2f-4c75-84cc-a400d4e60ee9 tempest-ServerActionsTestOtherA-1579685796 None] Terminate volume connection completed successfully. Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-f3b6de57-9d2f-4c75-84cc-a400d4e60ee9 tempest-ServerActionsTestOtherA-1579685796 None] Deleting attachment df72b95e-9814-4b76-86e3-e530ef980925. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:55 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:55 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-53e901d2-b2e2-4ec3-8ef1-e1866aeb8f9a req-ec319d69-1e9c-4fd1-87b7-6f4ee082b4ea tempest-AttachVolumeTestJSON-268527428 None] Terminate volume connection completed successfully. Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-53e901d2-b2e2-4ec3-8ef1-e1866aeb8f9a req-ec319d69-1e9c-4fd1-87b7-6f4ee082b4ea tempest-AttachVolumeTestJSON-268527428 None] Deleting attachment f192e7ce-32db-4131-8e18-ccce48c9e6e9. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:55 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.493s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f90e21-905a-40ea-925d-8135e8524b3c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:55 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:48:55 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:56 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.536s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:56 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:56 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:56 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.606s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:56 devstack sudo[94500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5 Aug 03 08:48:56 devstack sudo[94500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-b1760476-639e-47f1-90fb-c6c499876ac3 req-03ebc8c8-c8f0-44f4-ac63-64401667af33 tempest-AttachVolumeTestJSON-268527428 None] Terminate volume connection completed successfully. Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-b1760476-639e-47f1-90fb-c6c499876ac3 req-03ebc8c8-c8f0-44f4-ac63-64401667af33 tempest-AttachVolumeTestJSON-268527428 None] Deleting attachment 356711e6-a4f1-474d-af93-d69f425e2837. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:48:57 devstack sudo[94500]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.8ec3abff-1a6c-466d-893b-90255c5901b5" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-8ec3abff-1a6c-466d-893b-90255c5901b5" released by "_delete_snapshot" :: held 2.189s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" released by "delete_snapshot" :: held 2.264s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Created reservations ['a46b26fa-e142-4935-b14e-c01f9c16cb87', 'eec6617e-c129-4a9d-b605-7f69bfec3c58', 'ff8dcaea-d47d-4625-a32a-3df2e80a90b7', 'a6c84a32-615d-4506-83e0-e784c6970a40'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:48:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Delete snapshot completed successfully. Aug 03 08:48:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0da6026-0a94-46b7-a86f-218d579df5d0 tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-8ec3abff-1a6c-466d-893b-90255c5901b5-delete_snapshot" released by "delete_snapshot" :: held 2.481s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-4e438cfc-33b7-4d2f-9083-5100dd88a646 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-4e438cfc-33b7-4d2f-9083-5100dd88a646 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-4e438cfc-33b7-4d2f-9083-5100dd88a646 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-4e438cfc-33b7-4d2f-9083-5100dd88a646 tempest-ServerActionsTestOtherA-1579685796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-dca302a7-965a-4955-9fbf-e79aff4d91cd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7758b144-2c3e-4286-9df2-d5a30287e8fc', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:48:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-946e5389-54e0-48d8-ae06-9e8ac620b6f5 req-4e438cfc-33b7-4d2f-9083-5100dd88a646 tempest-ServerActionsTestOtherA-1579685796 None] attachment_update completed successfully. Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-37daf55f-b401-48e1-90b8-1e40bf13f1fd-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-37daf55f-b401-48e1-90b8-1e40bf13f1fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-37daf55f-b401-48e1-90b8-1e40bf13f1fd" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-37daf55f-b401-48e1-90b8-1e40bf13f1fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Deleting offline snapshot 37daf55f-b401-48e1-90b8-1e40bf13f1fd of volume 4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] snapshot_file for this snap is: volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cbd4f2-459c-4406-9c55-87d2edbf0a0a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:58 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:48:58 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:48:59 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Aug 03 08:48:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.774s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:48:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:48:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebd5844-fed0-4f8f-823a-7f683c9a1bad]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:48:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:48:59 devstack sudo[94622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 Aug 03 08:48:59 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:00 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2" returned: 0 in 0.800s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:00 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:49:00 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.544s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:00 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:00 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd Aug 03 08:49:00 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:01 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2.37daf55f-b401-48e1-90b8-1e40bf13f1fd" returned: 0 in 0.481s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-37daf55f-b401-48e1-90b8-1e40bf13f1fd" released by "_delete_snapshot" :: held 2.812s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" released by "delete_snapshot" :: held 2.841s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Created reservations ['7b07fcb8-1401-4a9c-ad41-fad8f04f8a2e', '7c4804fa-6203-46b3-a551-11d9945e4e5d', 'c7f396d9-20a5-4e60-b5ef-00144f09ce5a', '04908a6c-5a34-465a-aed7-a4c660b73592'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Delete snapshot completed successfully. Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0c02552c-a85a-49a5-8acc-5056a1bda1cf tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-37daf55f-b401-48e1-90b8-1e40bf13f1fd-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-4bae39d2-ad0b-4370-bd69-00acd1f367f2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-4bae39d2-ad0b-4370-bd69-00acd1f367f2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c10bb-fbf2-481f-b153-205cf01a9a33]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:02 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 Aug 03 08:49:02 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:02 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2" returned: 0 in 0.707s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:02 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2 Aug 03 08:49:02 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:03 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4bae39d2-ad0b-4370-bd69-00acd1f367f2" returned: 0 in 0.798s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-quobyte-4bae39d2-ad0b-4370-bd69-00acd1f367f2" released by "delete_volume" :: held 1.618s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:03 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Created reservations ['badf952b-e926-41e4-80ec-c7139f7f7795', '06fb648b-ae00-471e-bfce-6a0026a59697', '89a57d8b-d689-4b84-bbaa-f59d67ddd892', 'b2c008ee-56f6-4aaa-91ae-32458b694fba'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:04 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:04 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:04 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.521s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Deleted volume successfully. Aug 03 08:49:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f23cbeb0-16e1-47db-b594-1783442b4aef tempest-VolumesSnapshotListTestJSON-1687622476 None] Lock "cinder-4bae39d2-ad0b-4370-bd69-00acd1f367f2-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-75027d20-e752-4076-b0d3-e1f2fb447465-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-75027d20-e752-4076-b0d3-e1f2fb447465-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-quobyte-75027d20-e752-4076-b0d3-e1f2fb447465" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-75027d20-e752-4076-b0d3-e1f2fb447465" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9678ea-047f-42f8-88c1-ff1777da1459]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:06 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 Aug 03 08:49:06 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:06 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465" returned: 0 in 0.655s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:06 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465 Aug 03 08:49:06 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:07 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-75027d20-e752-4076-b0d3-e1f2fb447465" returned: 0 in 0.406s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-75027d20-e752-4076-b0d3-e1f2fb447465" released by "delete_volume" :: held 1.129s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Created reservations ['2df44ac1-df63-49f4-aad2-394f038100e1', '1ddd7a47-4f91-4196-b438-eabba8a04e10', 'a8549f8b-6405-4664-9ae9-0a08fada4545', '0a1d69d1-41cb-4e20-862e-96a7d4e1b89e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:07 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:07 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:07 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.454s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Deleted volume successfully. Aug 03 08:49:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7fc8303a-5b67-4e27-8e45-65b3fd9ce98d tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-75027d20-e752-4076-b0d3-e1f2fb447465-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-fd3bc03b-6630-4126-8162-50d6d4595ab4-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-fd3bc03b-6630-4126-8162-50d6d4595ab4-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-quobyte-fd3bc03b-6630-4126-8162-50d6d4595ab4" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-fd3bc03b-6630-4126-8162-50d6d4595ab4" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:08 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:08 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58ee0e2-6324-43e6-8656-4b007f2a4969]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:09 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 Aug 03 08:49:09 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:09 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 1.128s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:49:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:49:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:49:10 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4" returned: 0 in 1.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:10 devstack sudo[95110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4 Aug 03 08:49:10 devstack sudo[95110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:11 devstack sudo[95110]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd3bc03b-6630-4126-8162-50d6d4595ab4" returned: 0 in 0.828s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-fd3bc03b-6630-4126-8162-50d6d4595ab4" released by "delete_volume" :: held 2.454s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Created reservations ['1a770d0b-74d8-4026-a13a-96338cd9ef40', '7abc34f9-22ea-4adb-a55e-d1a1a5ca9729', '2f906bdc-d23d-4559-a3b0-7a274eb86d9c', '50e5821a-c19b-480e-ade4-6e99205b12e5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:11 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:11 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:12 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.569s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Deleted volume successfully. Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c968788a-75ec-483e-acb2-dda31995d9b1 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-fd3bc03b-6630-4126-8162-50d6d4595ab4-delete_volume" released by "delete_volume" :: held 3.774s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "cinder-quobyte-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" acquired by "delete_volume" :: waited 0.067s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4dfec67-93b2-4440-846f-d9ae8535ac41]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:13 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 Aug 03 08:49:13 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:14 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" returned: 0 in 1.128s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:14 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6 Aug 03 08:49:14 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:14 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-quobyte-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6" released by "delete_volume" :: held 1.750s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Created reservations ['66780df4-988d-44fe-a4a3-fa9e4267fffc', '64dc52c5-a9a6-4202-9a55-8a6a407da0a3', '92a85f4d-b798-4f50-bf8a-241c0dd44cf7', '24e6dd6b-60cd-428d-8812-bf9ac833f3d9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:15 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:15 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:15 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.549s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:15 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Deleted volume successfully. Aug 03 08:49:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6c88b974-20f0-4700-a7e5-566d997c0950 tempest-AttachVolumeTestJSON-268527428 None] Lock "cinder-f5d3a6f8-d8b1-4cfe-a3c3-7c768a240ab6-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:24 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=107,cinder:INSERT=21,cinder:UPDATE=80,cinder:DELETE=8 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:25 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=89,cinder:UPDATE=96,cinder:INSERT=33,cinder:DELETE=5 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Flow 'volume_create_manager' (87906dfc-ec32-4f63-a874-9f1fc0a14ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db8f8c-8faa-4772-9a58-5f0214ee1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45db8f8c-8faa-4772-9a58-5f0214ee1b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1843618308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e23ddd-40fa-4773-ab41-13c4ddc68ce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8451136f8c8f46b69d30c8893d3c9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:29Z,use_quota=True,user_id='bde8ca8f89c4482ba235833bc55a8398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b383e410-8844-4dcc-944f-e7545d9359cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b383e410-8844-4dcc-944f-e7545d9359cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fe1826-8546-4078-84eb-45247ff4a244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58fe1826-8546-4078-84eb-45247ff4a244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e23ddd-40fa-4773-ab41-13c4ddc68ce7', 'volume_name': 'volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2e0590-1dff-4c97-8d25-99ff1ea4c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a2e0590-1dff-4c97-8d25-99ff1ea4c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27112e54-ca73-4d98-9426-18a6ebb11b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Volume 72e23ddd-40fa-4773-ab41-13c4ddc68ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7', 'volume_size': 1} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1843618308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e23ddd-40fa-4773-ab41-13c4ddc68ce7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8451136f8c8f46b69d30c8893d3c9433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:29Z,use_quota=True,user_id='bde8ca8f89c4482ba235833bc55a8398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Creating volume 72e23ddd-40fa-4773-ab41-13c4ddc68ce7 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:49:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:29 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 1073741824 Aug 03 08:49:29 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:29 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 1073741824" returned: 0 in 0.606s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:30 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 Aug 03 08:49:30 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:30 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27112e54-ca73-4d98-9426-18a6ebb11b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f4403-be52-4e74-aabe-c48af9a6e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Volume volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 (72e23ddd-40fa-4773-ab41-13c4ddc68ce7): created successfully Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (701f4403-be52-4e74-aabe-c48af9a6e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Flow 'volume_create_manager' (87906dfc-ec32-4f63-a874-9f1fc0a14ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-0c8e920a-d9ae-4fcb-b94a-fc52ef0b61d2 req-acc05569-3685-4192-89b5-9b34e1188f9a tempest-VolumesGetTestJSON-622202282 None] Created volume successfully. Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Acquiring lock "cinder-72e23ddd-40fa-4773-ab41-13c4ddc68ce7-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "cinder-72e23ddd-40fa-4773-ab41-13c4ddc68ce7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Acquiring lock "cinder-quobyte-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "cinder-quobyte-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3fa33f-a1ba-452f-a522-2faf14938457]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:32 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 Aug 03 08:49:32 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:32 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" returned: 0 in 0.431s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:32 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7 Aug 03 08:49:32 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:32 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "cinder-quobyte-72e23ddd-40fa-4773-ab41-13c4ddc68ce7" released by "delete_volume" :: held 0.776s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG cinder.quota [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Created reservations ['3f2d00c4-5371-45fb-9de9-aad9ee97a42e', '29c5cf1d-9d6b-4764-93d2-fc144a44fde2', '362d95c5-b912-4893-a5b1-7604155b4a89', 'e930f1d1-6e1c-4227-a8d4-4167af3a6399'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:32 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:32 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:33 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:33 devstack cinder-volume[88796]: DEBUG cinder.manager [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Deleted volume successfully. Aug 03 08:49:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-d161479b-9c80-4a7d-aee3-086779f61161 req-6a2321ae-c59b-46f8-8106-eeafd311142e tempest-VolumesGetTestJSON-622202282 None] Lock "cinder-72e23ddd-40fa-4773-ab41-13c4ddc68ce7-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Flow 'volume_create_manager' (f2eaf94f-b8e2-4bd2-bd0d-fb7c83174d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5bd964-8c49-4359-b1b9-060ea1451891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5bd964-8c49-4359-b1b9-060ea1451891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-899478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2c6f66-25f0-4c79-af08-b2df9ce68188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b22b3bf92740068aef3c19aede15ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:39Z,use_quota=True,user_id='35d8980e0078457fa6517ccb94a174c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ab7812-b5c2-42be-b335-e0a028b5c879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ab7812-b5c2-42be-b335-e0a028b5c879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f935337b-29dc-4865-a7dc-e58a5171c20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f935337b-29dc-4865-a7dc-e58a5171c20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2c6f66-25f0-4c79-af08-b2df9ce68188', 'volume_name': 'volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b14fb8-1070-4e64-ad1e-8ae5a98548cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b14fb8-1070-4e64-ad1e-8ae5a98548cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e7aab-0312-4214-a9b0-a6ac57e41356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:38 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Volume 8a2c6f66-25f0-4c79-af08-b2df9ce68188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188', 'volume_size': 1} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-899478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2c6f66-25f0-4c79-af08-b2df9ce68188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b22b3bf92740068aef3c19aede15ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:39Z,use_quota=True,user_id='35d8980e0078457fa6517ccb94a174c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Creating volume 8a2c6f66-25f0-4c79-af08-b2df9ce68188 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:49:38 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:49:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:38 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 1073741824 Aug 03 08:49:38 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:39 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 1073741824" returned: 0 in 0.571s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:39 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 Aug 03 08:49:39 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:39 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91e7aab-0312-4214-a9b0-a6ac57e41356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b10fc0-20df-47c5-b1b9-ff6c46627a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:39 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Volume volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 (8a2c6f66-25f0-4c79-af08-b2df9ce68188): created successfully Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b10fc0-20df-47c5-b1b9-ff6c46627a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Flow 'volume_create_manager' (f2eaf94f-b8e2-4bd2-bd0d-fb7c83174d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-07ea015d-65c0-4fbb-b40a-57c17ff26c9f tempest-AttachVolumeShelveTestJSON-501979156 None] Created volume successfully. Aug 03 08:49:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8b63d8e5-06bb-4a98-8313-0b551fbd2ee1 tempest-GroupsTest-1736065576 None] Group tempest-Group1-2050020974: creating Aug 03 08:49:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8b63d8e5-06bb-4a98-8313-0b551fbd2ee1 tempest-GroupsTest-1736065576 None] Group tempest-Group1-2050020974: created successfully Aug 03 08:49:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8b63d8e5-06bb-4a98-8313-0b551fbd2ee1 tempest-GroupsTest-1736065576 None] Create group completed successfully. Aug 03 08:49:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-aed95929-8735-4374-ac91-02fb15505041 tempest-ServerActionsTestOtherA-1579685796 None] Terminate volume connection completed successfully. Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-aed95929-8735-4374-ac91-02fb15505041 tempest-ServerActionsTestOtherA-1579685796 None] Deleting attachment 7758b144-2c3e-4286-9df2-d5a30287e8fc. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "cinder-dca302a7-965a-4955-9fbf-e79aff4d91cd-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-dca302a7-965a-4955-9fbf-e79aff4d91cd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "cinder-quobyte-dca302a7-965a-4955-9fbf-e79aff4d91cd" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-quobyte-dca302a7-965a-4955-9fbf-e79aff4d91cd" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf2ec69-16fc-4822-a5e8-0a5bddffa6e4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:40 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd Aug 03 08:49:40 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:41 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd" returned: 0 in 0.819s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:41 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd Aug 03 08:49:41 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7cd2e623-4d98-4c70-9b7d-0577ec8a6bf2 tempest-GroupsTest-1736065576 None] Group tempest-Group2-433999107: creating Aug 03 08:49:41 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dca302a7-965a-4955-9fbf-e79aff4d91cd" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-quobyte-dca302a7-965a-4955-9fbf-e79aff4d91cd" released by "delete_volume" :: held 1.247s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Flow 'volume_create_manager' (bf151949-d28f-4cff-a72b-3a61a86d1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b315f53-f885-4e88-a9b0-ad0ffee4c0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b315f53-f885-4e88-a9b0-ad0ffee4c0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-410751325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2cccaf-c71a-4aa8-ac4d-08582b15bae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213503bb66d7484dbc51870c249dc904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:42Z,use_quota=True,user_id='8967d247eac24cec92d739fb5b3f8028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4ca29-9a09-40cd-a47b-31ab75bef15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb4ca29-9a09-40cd-a47b-31ab75bef15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128580ec-f93c-49e9-838e-da2d477bddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128580ec-f93c-49e9-838e-da2d477bddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2cccaf-c71a-4aa8-ac4d-08582b15bae2', 'volume_name': 'volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57c66d-7b1a-43f0-9ed9-df7560b90dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b57c66d-7b1a-43f0-9ed9-df7560b90dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d500667-deb9-44cc-af5d-c094b9b16d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:41 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Volume 7a2cccaf-c71a-4aa8-ac4d-08582b15bae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2', 'volume_size': 1} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-410751325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2cccaf-c71a-4aa8-ac4d-08582b15bae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213503bb66d7484dbc51870c249dc904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:42Z,use_quota=True,user_id='8967d247eac24cec92d739fb5b3f8028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Creating volume 7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:49:41 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:49:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7cd2e623-4d98-4c70-9b7d-0577ec8a6bf2 tempest-GroupsTest-1736065576 None] Group tempest-Group2-433999107: created successfully Aug 03 08:49:42 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 1073741824 Aug 03 08:49:42 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7cd2e623-4d98-4c70-9b7d-0577ec8a6bf2 tempest-GroupsTest-1736065576 None] Create group completed successfully. Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.quota [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Created reservations ['544358a8-bf64-45bf-b6fa-88b0fd2d00e5', 'd1e080c0-9f0d-4ff5-bfeb-d4b44691fc9b', 'd3ef603a-859f-4dd5-a91e-13655ea06a28', '3c6d5275-58fc-4a71-8882-f445f4b64017'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:42 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:42 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:42 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.312s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.manager [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Deleted volume successfully. Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7567fa79-93f5-47c2-86a4-2096f61ad6dd req-8266872f-29ee-4aa1-a7dc-52226cebaa36 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-dca302a7-965a-4955-9fbf-e79aff4d91cd-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:42 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 1073741824" returned: 0 in 0.555s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:42 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:49:42 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:42 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "cinder-6d3d7bd1-212e-4da6-a004-ecfbb57a5222-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.350s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-6d3d7bd1-212e-4da6-a004-ecfbb57a5222-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d500667-deb9-44cc-af5d-c094b9b16d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4c3af9-6d11-44fb-b583-c3f2eb114db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Volume volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 (7a2cccaf-c71a-4aa8-ac4d-08582b15bae2): created successfully Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4c3af9-6d11-44fb-b583-c3f2eb114db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Flow 'volume_create_manager' (bf151949-d28f-4cff-a72b-3a61a86d1efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "cinder-quobyte-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8727ea8d-6d43-491d-9c64-5da6103f4602 tempest-TestImageHashVerification-1942583380 None] Created volume successfully. Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-quobyte-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ab0c6e-06f6-46a0-a76c-294933741146]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:43 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 Aug 03 08:49:43 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (1a738162-9110-4652-a7db-4c01d0a12617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21038085-6771-492b-a0fd-fdc6bfa5e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21038085-6771-492b-a0fd-fdc6bfa5e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477580701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66a5fff4-09b3-4e1f-acbe-94b853c5eb75,host='devstack@QuobyteHD#QuobyteHD',id=df4bc2c6-57a6-4628-ba4c-0c375ec78440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:43Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b996996d-19f1-4416-beed-d8b50ebfd5e9),volume_type_id=b996996d-19f1-4416-beed-d8b50ebfd5e9)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678912c8-1c62-4bae-bdf4-64ee2f71a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678912c8-1c62-4bae-bdf4-64ee2f71a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c93bee-6f2d-4632-af5d-db57f6ff4259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c93bee-6f2d-4632-af5d-db57f6ff4259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df4bc2c6-57a6-4628-ba4c-0c375ec78440', 'volume_name': 'volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395f2d13-eab6-46f6-b6d5-6d60d4f92202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (395f2d13-eab6-46f6-b6d5-6d60d4f92202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadc4e9a-5277-4ea8-a7f1-e07f0b80726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Volume df4bc2c6-57a6-4628-ba4c-0c375ec78440: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440', 'volume_size': 1} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=66a5fff4-09b3-4e1f-acbe-94b853c5eb75,created_at=2026-08-03T06:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477580701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=66a5fff4-09b3-4e1f-acbe-94b853c5eb75,host='devstack@QuobyteHD#QuobyteHD',id=df4bc2c6-57a6-4628-ba4c-0c375ec78440,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:43Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b996996d-19f1-4416-beed-d8b50ebfd5e9),volume_type_id=b996996d-19f1-4416-beed-d8b50ebfd5e9)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Creating volume df4bc2c6-57a6-4628-ba4c-0c375ec78440 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:49:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:43 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 1073741824 Aug 03 08:49:43 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:43 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" returned: 0 in 0.495s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:43 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222 Aug 03 08:49:43 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:43 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-quobyte-6d3d7bd1-212e-4da6-a004-ecfbb57a5222" released by "delete_volume" :: held 0.895s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Created reservations ['7574e292-6637-4121-b3b1-fe05fc2e9f46', 'a24be3fb-397a-4c4f-8c7b-af80af8dac95', 'bef15287-6256-45d5-b680-cb8e682cbd2b', '77138d73-b8f9-4f7b-9c85-b0741ae35730'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:44 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 1073741824" returned: 0 in 0.687s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:44 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:44 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:44 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 Aug 03 08:49:44 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:44 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:44 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadc4e9a-5277-4ea8-a7f1-e07f0b80726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390cd2f2-e185-4f3f-95d4-3b2600fd0dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Deleted volume successfully. Aug 03 08:49:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Volume volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 (df4bc2c6-57a6-4628-ba4c-0c375ec78440): created successfully Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390cd2f2-e185-4f3f-95d4-3b2600fd0dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (1a738162-9110-4652-a7db-4c01d0a12617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-63433187-a408-45a5-a20e-b43ac254754f tempest-GroupsTest-1736065576 None] Created volume successfully. Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e9ba333-e695-4b54-90e0-d6b247fa3cb1 tempest-ServerActionsTestOtherA-1579685796 None] Lock "cinder-6d3d7bd1-212e-4da6-a004-ecfbb57a5222-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d585cf-a1cf-4d4c-877b-9c4ce16cdb4e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:45 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:49:45 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:45 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6baec6-ae3e-483f-9fb7-7cd17471f957]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:45 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:49:45 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:45 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.499s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 /opt/stack/data/cinder/conversion/7a2cccaf-c71a-4aa8-ac4d-08582b15bae2.temp_image.92b080ae-b29a-4c7e-bcef-c710ec28bb699mvjq6sw.img {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:45 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 /opt/stack/data/cinder/conversion/7a2cccaf-c71a-4aa8-ac4d-08582b15bae2.temp_image.92b080ae-b29a-4c7e-bcef-c710ec28bb699mvjq6sw.img Aug 03 08:49:45 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Acquiring lock "cinder-quobyte-df4bc2c6-57a6-4628-ba4c-0c375ec78440" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:49:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-df4bc2c6-57a6-4628-ba4c-0c375ec78440" acquired by "delete_volume" :: waited 0.092s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:49:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[561b26cb-df43-4546-9526-8008126ed968]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:48 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 Aug 03 08:49:48 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:49 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440" returned: 0 in 1.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:49 devstack sudo[95502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440 Aug 03 08:49:49 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:49 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-df4bc2c6-57a6-4628-ba4c-0c375ec78440" returned: 0 in 0.744s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-df4bc2c6-57a6-4628-ba4c-0c375ec78440" released by "delete_volume" :: held 2.148s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Created reservations ['18a4b279-11d0-4f1b-a29a-feea4772aa1a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:50 devstack cinder-volume[88796]: WARNING cinder.quota [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-480823175 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-480823175, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:49:50 devstack cinder-volume[88796]: WARNING cinder.quota [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-480823175 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-480823175, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Created reservations ['b013c6b1-719c-4a6e-abe5-a08757db5145', '69071487-90d6-4ee9-bd36-d05636bbcb2a', '24ad53f3-c5c1-4aba-b245-ec4d1364dc25', 'f9e22447-7f9f-4fdc-9705-b700f677711e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:50 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:50 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:51 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.623s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-65c5f969-1a8d-42ed-9551-144b2f756930 tempest-GroupsTest-1736065576 None] Delete group completed successfully. Aug 03 08:49:51 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Created reservations ['c16b5b2e-f3a0-43db-ab90-2c2767f245f8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:52 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:49:52 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:52 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 /opt/stack/data/cinder/conversion/7a2cccaf-c71a-4aa8-ac4d-08582b15bae2.temp_image.92b080ae-b29a-4c7e-bcef-c710ec28bb699mvjq6sw.img" returned: 0 in 6.867s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a86ee63-34ac-47e5-af65-cbce91e62866]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:49:52 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.617s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:49:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d98ee75c-6576-4206-b2c8-e3ecb1965edd tempest-GroupsTest-1736065576 None] Delete group completed successfully. Aug 03 08:49:52 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:49:52 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:49:53 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Aug 03 08:49:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.675s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:49:53 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/conversion/7a2cccaf-c71a-4aa8-ac4d-08582b15bae2.temp_image.92b080ae-b29a-4c7e-bcef-c710ec28bb699mvjq6sw.img {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:49:53 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Converted 1024.00 MB image at 149.07 MB/s Aug 03 08:49:53 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] 92b080ae-b29a-4c7e-bcef-c710ec28bb69 was raw, no need to convert to raw {{(pid=88796) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 08:49:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-717a1fda-313e-4877-ab28-7de736a5e44c tempest-GroupsTest-1736065576 None] Group tempest-GroupsTest-Group-1793931723: creating Aug 03 08:49:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-717a1fda-313e-4877-ab28-7de736a5e44c tempest-GroupsTest-1736065576 None] Group tempest-GroupsTest-Group-1793931723: created successfully Aug 03 08:49:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-717a1fda-313e-4877-ab28-7de736a5e44c tempest-GroupsTest-1736065576 None] Create group completed successfully. Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (55bc878e-4aaa-488e-a363-fdf8112b807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3209cf1-2b04-4488-b390-d47d8a869a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3209cf1-2b04-4488-b390-d47d8a869a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1875483590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c1c4f19-020e-4aad-9d29-804b742f3800,host='devstack@QuobyteHD#QuobyteHD',id=25daf2ef-b7b5-4546-a434-423ae86b9ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:55Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f),volume_type_id=171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226a841a-09bc-4b3d-b4b4-f6942289b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226a841a-09bc-4b3d-b4b4-f6942289b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea75b99e-f681-4a68-8745-9d0a6dfda21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea75b99e-f681-4a68-8745-9d0a6dfda21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25daf2ef-b7b5-4546-a434-423ae86b9ae4', 'volume_name': 'volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19565a9b-f190-4c3b-8935-dcd0c14b5f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19565a9b-f190-4c3b-8935-dcd0c14b5f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22b2ca0-2528-4711-8337-83b22a8d7862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:49:55 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Volume 25daf2ef-b7b5-4546-a434-423ae86b9ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4', 'volume_size': 1} Aug 03 08:49:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:49:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-61add8d9-6934-4779-aa60-24f00d2b4042 req-d37e4a8e-81f9-46e4-88a2-894b3aa039c7 tempest-AttachVolumeShelveTestJSON-501979156 None] No connector for attachment 4a3b67bb-38c1-423c-b642-75433134c242; skipping storage backend terminate_connection call. {{(pid=88796) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 03 08:49:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-61add8d9-6934-4779-aa60-24f00d2b4042 req-d37e4a8e-81f9-46e4-88a2-894b3aa039c7 tempest-AttachVolumeShelveTestJSON-501979156 None] Deleting attachment 4a3b67bb-38c1-423c-b642-75433134c242. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:50:05 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=53,cinder:UPDATE=54,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:50:06 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=51,cinder:SELECT=38,cinder:INSERT=12,cinder:DELETE=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:08 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:50:08 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:09 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.507s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:50:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:50:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:50:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.932s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Uploaded volume to glance image-id: 92b080ae-b29a-4c7e-bcef-c710ec28bb69. {{(pid=88796) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.244s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c1c4f19-020e-4aad-9d29-804b742f3800,created_at=2026-08-03T06:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1875483590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c1c4f19-020e-4aad-9d29-804b742f3800,host='devstack@QuobyteHD#QuobyteHD',id=25daf2ef-b7b5-4546-a434-423ae86b9ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:49:55Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f),volume_type_id=171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Creating volume 25daf2ef-b7b5-4546-a434-423ae86b9ae4 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:50:22 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:50:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:22 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 1073741824 Aug 03 08:50:22 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-92740442-4b34-4c8a-a475-38895aa809ac tempest-TestImageHashVerification-1942583380 None] Copy volume to image completed successfully. Aug 03 08:50:24 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 1073741824" returned: 0 in 1.153s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:24 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 Aug 03 08:50:24 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Acquiring lock "cinder-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "cinder-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Acquiring lock "cinder-quobyte-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "cinder-quobyte-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebf7a9e-7786-406b-853f-87c01bfda5db]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:24 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4" returned: 0 in 0.743s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22b2ca0-2528-4711-8337-83b22a8d7862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db6eb16-abc4-4955-a8b5-e08db1227d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Volume volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 (25daf2ef-b7b5-4546-a434-423ae86b9ae4): created successfully Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db6eb16-abc4-4955-a8b5-e08db1227d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:24 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:50:24 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (55bc878e-4aaa-488e-a363-fdf8112b807e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-52760703-1cb4-43bb-8e5d-882815c4f059 tempest-GroupsTest-1736065576 None] Created volume successfully. Aug 03 08:50:25 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.760s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:25 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2 Aug 03 08:50:25 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:25 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" returned: 0 in 0.503s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "cinder-quobyte-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2" released by "delete_volume" :: held 1.379s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Created reservations ['4ed77762-6511-4af2-bc72-67a54bbdbc8c', '68c98941-9237-47bf-8507-708617b3c107', '83b7fcc8-a27c-45c0-86e6-42b3ada812ec', '976dbb3a-e7fd-46d6-ac33-4db2c509b396'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:26 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:50:26 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:26 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:50:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Deleted volume successfully. Aug 03 08:50:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f30ff1ec-5c71-439c-b7fb-0a925a7933cb tempest-TestImageHashVerification-1942583380 None] Lock "cinder-7a2cccaf-c71a-4aa8-ac4d-08582b15bae2-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (ab381834-5e26-4b68-88ea-1968ececf903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c2bb8-3930-47c3-85b4-aee15cb24425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c66c2bb8-3930-47c3-85b4-aee15cb24425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827177660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c1c4f19-020e-4aad-9d29-804b742f3800,host='devstack@QuobyteHD#QuobyteHD',id=c507499a-a86f-4a5a-985e-a3c640111d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:27Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f),volume_type_id=171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6f0527-646f-4e98-b827-0fe468670e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6f0527-646f-4e98-b827-0fe468670e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771d5657-2ab7-4419-9384-3c4bc92954f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (771d5657-2ab7-4419-9384-3c4bc92954f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c507499a-a86f-4a5a-985e-a3c640111d10', 'volume_name': 'volume-c507499a-a86f-4a5a-985e-a3c640111d10', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7ae99b-c2ad-48aa-845e-016fa386e391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7ae99b-c2ad-48aa-845e-016fa386e391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c731ce9e-2995-4c5e-bb3a-bc1d116af7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Volume c507499a-a86f-4a5a-985e-a3c640111d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c507499a-a86f-4a5a-985e-a3c640111d10', 'volume_size': 1} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0c1c4f19-020e-4aad-9d29-804b742f3800,created_at=2026-08-03T06:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-827177660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0c1c4f19-020e-4aad-9d29-804b742f3800,host='devstack@QuobyteHD#QuobyteHD',id=c507499a-a86f-4a5a-985e-a3c640111d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3311df69bb4849978b98050328e54056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:27Z,use_quota=True,user_id='47f7277b74e6470fb59d6ad583a5ad86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f),volume_type_id=171ebf9a-3b50-4ed6-93c1-8e5e58d37a1f)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Creating volume c507499a-a86f-4a5a-985e-a3c640111d10 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:50:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:27 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 1073741824 Aug 03 08:50:27 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:27 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 1073741824" returned: 0 in 0.567s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:27 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 Aug 03 08:50:27 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:28 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c731ce9e-2995-4c5e-bb3a-bc1d116af7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c507499a-a86f-4a5a-985e-a3c640111d10', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb84808-bc13-484b-83cf-0d5dbc7649f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Volume volume-c507499a-a86f-4a5a-985e-a3c640111d10 (c507499a-a86f-4a5a-985e-a3c640111d10): created successfully Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb84808-bc13-484b-83cf-0d5dbc7649f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Flow 'volume_create_manager' (ab381834-5e26-4b68-88ea-1968ececf903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-084376fc-569f-4861-8395-29d3301f474f tempest-GroupsTest-1736065576 None] Created volume successfully. Aug 03 08:50:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4970e482-73f5-4a26-9b5f-10576d7101e7 tempest-GroupsTest-1736065576 None] Update group completed successfully. Aug 03 08:50:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ae89b03c-4559-4ad5-b3b4-6de66f78e0a7 tempest-GroupsTest-1736065576 None] Update group completed successfully. Aug 03 08:50:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Acquiring lock "cinder-quobyte-25daf2ef-b7b5-4546-a434-423ae86b9ae4" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-25daf2ef-b7b5-4546-a434-423ae86b9ae4" acquired by "delete_volume" :: waited 0.073s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe44f7e-bec5-42e9-8456-cc8de1e61ef3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:34 devstack sudo[95943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 Aug 03 08:50:34 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:34 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4" returned: 0 in 0.954s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:34 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4 Aug 03 08:50:34 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:35 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-25daf2ef-b7b5-4546-a434-423ae86b9ae4" returned: 0 in 0.500s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-25daf2ef-b7b5-4546-a434-423ae86b9ae4" released by "delete_volume" :: held 1.588s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Acquiring lock "cinder-quobyte-c507499a-a86f-4a5a-985e-a3c640111d10" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-c507499a-a86f-4a5a-985e-a3c640111d10" acquired by "delete_volume" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48f47ea-e5e1-4d02-b3bd-09a5c0695e24]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:35 devstack sudo[95951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 Aug 03 08:50:35 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:36 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10" returned: 0 in 1.029s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:36 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10 Aug 03 08:50:36 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:37 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c507499a-a86f-4a5a-985e-a3c640111d10" returned: 0 in 1.014s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "cinder-quobyte-c507499a-a86f-4a5a-985e-a3c640111d10" released by "delete_volume" :: held 2.162s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Created reservations ['be6b6f88-0bac-427f-bfe0-00a00882197a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:50:38 devstack cinder-volume[88796]: WARNING cinder.quota [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1741606914 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1741606914, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:50:38 devstack cinder-volume[88796]: WARNING cinder.quota [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1741606914 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1741606914, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Created reservations ['1f427c5c-10ec-4900-a815-6c012c6952a7', '773aebf5-0fbd-4b75-9690-f128812eee0e', '10732c97-9b98-4edb-8643-7b4ef66ec055', '237dc086-3af9-436e-b8b5-008ac929d080'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Created reservations ['8a78032f-8055-4c73-ab64-151910b80003', '01a903e6-ab39-425c-918d-cc49205b305b', 'd6315005-93f9-4cc8-966b-d0de23d5f306', '391e8686-d701-4753-9966-e22d984e8375'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:38 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:50:38 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:39 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.680s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:50:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64ea9217-278c-4dc4-a0c7-7c0094d9eaa4 tempest-GroupsTest-1736065576 None] Delete group completed successfully. Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Acquiring lock "cinder-8a2c6f66-25f0-4c79-af08-b2df9ce68188-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "cinder-8a2c6f66-25f0-4c79-af08-b2df9ce68188-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Acquiring lock "cinder-quobyte-8a2c6f66-25f0-4c79-af08-b2df9ce68188" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "cinder-quobyte-8a2c6f66-25f0-4c79-af08-b2df9ce68188" acquired by "delete_volume" :: waited 0.050s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52e5124-75f7-4a82-938d-2130e54cdfe9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:45 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 Aug 03 08:50:45 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:46 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188" returned: 0 in 0.743s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:46 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188 Aug 03 08:50:46 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:46 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8a2c6f66-25f0-4c79-af08-b2df9ce68188" returned: 0 in 0.466s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "cinder-quobyte-8a2c6f66-25f0-4c79-af08-b2df9ce68188" released by "delete_volume" :: held 1.311s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Created reservations ['4bd358f6-c9a9-4e40-88ef-6c6207f3eb93', '8765bab3-1c84-4a91-836a-22a93e871ea2', 'f2bef426-882a-470c-af51-63f391dae658', 'b427bcb0-622e-4968-ac72-f723098265f4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:47 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:50:47 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:47 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:47 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:50:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Deleted volume successfully. Aug 03 08:50:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cde16687-337f-4cef-9442-be09c9fb2219 tempest-AttachVolumeShelveTestJSON-501979156 None] Lock "cinder-8a2c6f66-25f0-4c79-af08-b2df9ce68188-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Flow 'volume_create_manager' (5938dcec-5021-428d-9169-1d3861bd459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf7debd-cc56-4af3-8bc2-7b59daf5767e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf7debd-cc56-4af3-8bc2-7b59daf5767e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1611724519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfb66f5-9bef-45e2-9cc4-5d19a19741d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05719e666d80437ba91b299caea9d18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:51Z,use_quota=True,user_id='a70da7c332fd4ccab4d583b1c796eca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c79ff56-5a63-4a0c-b093-8a5922e9a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c79ff56-5a63-4a0c-b093-8a5922e9a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca18d78-3610-48f5-8705-83416c916bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aca18d78-3610-48f5-8705-83416c916bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfb66f5-9bef-45e2-9cc4-5d19a19741d4', 'volume_name': 'volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acde9e2c-35ab-48c9-bfba-86f31ab0ab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acde9e2c-35ab-48c9-bfba-86f31ab0ab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953d5a6-6661-4ce2-be58-41f2a6d9edd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Volume 5bfb66f5-9bef-45e2-9cc4-5d19a19741d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4', 'volume_size': 1} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1611724519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfb66f5-9bef-45e2-9cc4-5d19a19741d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05719e666d80437ba91b299caea9d18e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:51Z,use_quota=True,user_id='a70da7c332fd4ccab4d583b1c796eca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Creating volume 5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:50:50 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:50:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:50 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 1073741824 Aug 03 08:50:50 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:51 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 1073741824" returned: 0 in 0.669s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:51 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 Aug 03 08:50:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:52 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" returned: 0 in 0.575s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a953d5a6-6661-4ce2-be58-41f2a6d9edd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0b31c8-ddd6-4ff8-8a73-40554167dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Volume volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 (5bfb66f5-9bef-45e2-9cc4-5d19a19741d4): created successfully Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0b31c8-ddd6-4ff8-8a73-40554167dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Flow 'volume_create_manager' (5938dcec-5021-428d-9169-1d3861bd459c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d9e41c49-da64-45f7-b620-751ab97b0420 tempest-ServerRescueNegativeTestJSON-1028416391 None] Created volume successfully. Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Flow 'volume_create_manager' (000c459b-cdf7-43f4-b08b-3e964d9fc07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae8e804-5536-4baa-9d8c-413ce2a0c702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae8e804-5536-4baa-9d8c-413ce2a0c702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1461749244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de4d2ea-4dae-42e0-87f0-c1c6e868e91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd083b43f4ee41bfa2b1b52e42674577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:52Z,use_quota=True,user_id='d035e7da2f184efbabc66cdedf7f0315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33be4044-3653-4e6f-b829-2d6b2eb37e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33be4044-3653-4e6f-b829-2d6b2eb37e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6802e6-2faf-4b17-9941-e213e19aae6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b6802e6-2faf-4b17-9941-e213e19aae6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de4d2ea-4dae-42e0-87f0-c1c6e868e91c', 'volume_name': 'volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f03c73c-ccb9-4f23-a95f-2744dff89b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f03c73c-ccb9-4f23-a95f-2744dff89b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba84417-2cbc-4062-9ef1-a2ea9c1504c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c', 'volume_size': 1} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1461749244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de4d2ea-4dae-42e0-87f0-c1c6e868e91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd083b43f4ee41bfa2b1b52e42674577',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:50:52Z,use_quota=True,user_id='d035e7da2f184efbabc66cdedf7f0315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Creating volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:50:52 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:50:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:52 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c 1073741824 Aug 03 08:50:52 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:53 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c 1073741824" returned: 0 in 0.923s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:53 devstack sudo[96111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c Aug 03 08:50:53 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:54 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" returned: 0 in 0.387s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba84417-2cbc-4062-9ef1-a2ea9c1504c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3fa9e9-76aa-40f4-aaff-6232882879a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:50:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Volume volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c (6de4d2ea-4dae-42e0-87f0-c1c6e868e91c): created successfully Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3fa9e9-76aa-40f4-aaff-6232882879a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:50:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Flow 'volume_create_manager' (000c459b-cdf7-43f4-b08b-3e964d9fc07b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:50:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d17492f5-0fa2-43be-bf2c-59bf584c5ee4 tempest-SnapshotsActionsTest-1487943296 None] Created volume successfully. Aug 03 08:50:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:50:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:50:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Creating offline snapshot 9ffde5b0-ccc2-4e74-a724-c815e706d3a2 of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:50:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bcbcf-6aeb-4d26-ac70-8ef9088a355b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:50:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:55 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c Aug 03 08:50:55 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:56 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" returned: 0 in 0.826s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:56 devstack sudo[96120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 1G Aug 03 08:50:56 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:56 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 1G" returned: 0 in 0.822s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:56 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:50:56 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:57 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.809s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 is being set with open permissions: ugo+rw Aug 03 08:50:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:57 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:50:57 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:58 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.544s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:58 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info Aug 03 08:50:58 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:58 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info" returned: 0 in 0.550s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:58 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info is being set with open permissions: ugo+rw Aug 03 08:50:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:50:58 devstack sudo[96169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info Aug 03 08:50:58 devstack sudo[96169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:50:59 devstack sudo[96169]: pam_unix(sudo:session): session closed for user root Aug 03 08:50:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.info" returned: 0 in 0.435s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:50:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.165s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:50:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4b146490-2c2d-4b70-a4bc-4daef413f400 tempest-SnapshotsActionsTest-1487943296 None] Create snapshot completed successfully Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Creating offline snapshot f75f70f2-17d0-420b-a340-8f8e10923cd6 of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[de04e0c6-3975-4c0d-94e7-e8b9f557b43d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:02 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:02 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Flow 'volume_create_manager' (83fb2540-8831-495e-9b32-7b26978726cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a308c4-1ddc-4f7c-b6cb-6637a7718336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a308c4-1ddc-4f7c-b6cb-6637a7718336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-214772789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d65e062-0bb1-48f8-b280-643382bc3582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4f8027dc4d4c92aaf6f31baba755b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:02Z,use_quota=True,user_id='cf4295a6cb67412987b352bad2b09ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd5614-882f-4aae-94c3-1bd05417f0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5dd5614-882f-4aae-94c3-1bd05417f0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ea1bac-10ea-438e-a1cc-0e0144b8c0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ea1bac-10ea-438e-a1cc-0e0144b8c0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d65e062-0bb1-48f8-b280-643382bc3582', 'volume_name': 'volume-2d65e062-0bb1-48f8-b280-643382bc3582', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da7be57-6795-4330-b216-5d8c4d6e8b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da7be57-6795-4330-b216-5d8c4d6e8b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d100c4de-e74a-4dc6-88df-273ed773da67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:02 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Volume 2d65e062-0bb1-48f8-b280-643382bc3582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d65e062-0bb1-48f8-b280-643382bc3582', 'volume_size': 1} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:02 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.615s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:02 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 1G Aug 03 08:51:02 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:03 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 1G" returned: 0 in 0.694s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:03 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 Aug 03 08:51:03 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:03 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:03 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 is being set with open permissions: ugo+rw Aug 03 08:51:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:03 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 Aug 03 08:51:03 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:04 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-214772789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d65e062-0bb1-48f8-b280-643382bc3582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b4f8027dc4d4c92aaf6f31baba755b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:02Z,use_quota=True,user_id='cf4295a6cb67412987b352bad2b09ad4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Creating volume 2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:04 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:04 devstack sudo[96262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 1073741824 Aug 03 08:51:04 devstack sudo[96262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-516d600d-ec01-40ca-b53e-263cb2ab4679 tempest-SnapshotsActionsTest-1487943296 None] Create snapshot completed successfully Aug 03 08:51:04 devstack sudo[96262]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 1073741824" returned: 0 in 0.616s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:04 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 Aug 03 08:51:04 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-f75f70f2-17d0-420b-a340-8f8e10923cd6-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-f75f70f2-17d0-420b-a340-8f8e10923cd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-f75f70f2-17d0-420b-a340-8f8e10923cd6" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-f75f70f2-17d0-420b-a340-8f8e10923cd6" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:05 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Deleting offline snapshot f75f70f2-17d0-420b-a340-8f8e10923cd6 of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] snapshot_file for this snap is: volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d100c4de-e74a-4dc6-88df-273ed773da67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d65e062-0bb1-48f8-b280-643382bc3582', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd8472-852c-41c8-bc48-da49f338b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38b466c-4ff2-4bdc-b287-72db1f16d346]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:05 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Volume volume-2d65e062-0bb1-48f8-b280-643382bc3582 (2d65e062-0bb1-48f8-b280-643382bc3582): created successfully Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cadd8472-852c-41c8-bc48-da49f338b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Flow 'volume_create_manager' (83fb2540-8831-495e-9b32-7b26978726cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-15c01a67-7598-4a66-bfae-9b2571f655e6 req-b6079990-72b1-48b7-aa82-73046b9cc858 tempest-VolumesSnapshotsTestJSON-414436316 None] Created volume successfully. Aug 03 08:51:05 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 Aug 03 08:51:05 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:05 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6" returned: 0 in 0.582s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[796fe131-6155-430a-b597-b4c33fba5d26]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Creating offline snapshot 1a204a24-4cc7-4812-8826-854187837763 of volume 2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e84b28b-ab95-44d2-aacd-0fca14a1b64d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:06 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:06 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:06 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 Aug 03 08:51:06 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:06 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.756s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:06 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 Aug 03 08:51:06 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:06 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582" returned: 0 in 0.726s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:07 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 1G Aug 03 08:51:07 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Acquiring lock "cinder-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "cinder-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Acquiring lock "cinder-quobyte-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "cinder-quobyte-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fb3e20-8f1f-4488-bb1f-68c44aaafa10]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:07 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 Aug 03 08:51:07 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:07 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6" returned: 0 in 1.002s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:07 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6 Aug 03 08:51:07 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:08 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 1G" returned: 0 in 1.109s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d65e062-0bb1-48f8-b280-643382bc3582 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:08 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" returned: 0 in 0.605s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:08 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d65e062-0bb1-48f8-b280-643382bc3582 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 Aug 03 08:51:08 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:08 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4 Aug 03 08:51:08 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:08 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.f75f70f2-17d0-420b-a340-8f8e10923cd6" returned: 0 in 0.804s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-f75f70f2-17d0-420b-a340-8f8e10923cd6" released by "_delete_snapshot" :: held 3.417s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:08 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:08 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_snapshot" :: held 3.491s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:08 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d65e062-0bb1-48f8-b280-643382bc3582 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763" returned: 0 in 0.733s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:08 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 is being set with open permissions: ugo+rw Aug 03 08:51:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:08 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 Aug 03 08:51:08 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Created reservations ['f53c03e8-7125-4150-a5d8-f689d5151d59', '36b8ba73-ee14-4516-b477-4e1c6244ca87', '0a17e321-af5f-4fde-b408-d4827edafca2', '729d49e2-9ec6-4c16-a226-41e049c717f3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Delete snapshot completed successfully. Aug 03 08:51:09 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" returned: 0 in 0.992s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b8df7024-df18-4a4e-aa18-0d540311683e tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-f75f70f2-17d0-420b-a340-8f8e10923cd6-delete_snapshot" released by "delete_snapshot" :: held 3.914s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "cinder-quobyte-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4" released by "delete_volume" :: held 1.741s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Created reservations ['15fc5bd5-926f-4406-aa9a-cbef59471d80', '48326dc2-8061-4925-9a08-29f098e5e5b4', 'ee95d395-a734-4b5b-82bd-970d58e00a7a', '16c29d1a-a770-4bec-afe3-1ceaff81c18d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:09 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.880s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:51:09 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:09 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:09 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763" returned: 0 in 0.895s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:09 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info Aug 03 08:51:09 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:10 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.679s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Deleted volume successfully. Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f08afbc2-3c3a-4941-ada8-cb8a8bd3a0e2 tempest-ServerRescueNegativeTestJSON-1028416391 None] Lock "cinder-5bfb66f5-9bef-45e2-9cc4-5d19a19741d4-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:10 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info" returned: 0 in 0.658s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:10 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info is being set with open permissions: ugo+rw Aug 03 08:51:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:10 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info Aug 03 08:51:10 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:11 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.info" returned: 0 in 0.540s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.072s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.662s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Creating offline snapshot dc9caf56-a590-4056-8a98-163a42f4f7ef of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ff53ca-5d45-4b6e-9bed-29222e64b94a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-a4bba9cf-a947-469b-91e5-d097a841b131 req-8417e618-4b1d-4fe5-8359-c603edf0f3fb tempest-VolumesSnapshotsTestJSON-414436316 None] Create snapshot completed successfully Aug 03 08:51:11 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:11 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:11 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.689s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:11 devstack sudo[96394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef 1G Aug 03 08:51:11 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "cinder-1a204a24-4cc7-4812-8826-854187837763-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-1a204a24-4cc7-4812-8826-854187837763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "cinder-quobyte-1a204a24-4cc7-4812-8826-854187837763" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-1a204a24-4cc7-4812-8826-854187837763" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Deleting offline snapshot 1a204a24-4cc7-4812-8826-854187837763 of volume 2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] snapshot_file for this snap is: volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23b4ba5-57ee-476d-83ba-372ac0dbf567]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:12 devstack sudo[96400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 Aug 03 08:51:12 devstack sudo[96400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:12 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef 1G" returned: 0 in 1.022s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:13 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef Aug 03 08:51:13 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:13 devstack sudo[96400]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763" returned: 0 in 0.737s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d65e062-0bb1-48f8-b280-643382bc3582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5d329b-fcd3-41e0-8dc4-501fce4089f9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:13 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 Aug 03 08:51:13 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:13 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef" returned: 0 in 0.765s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:13 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef is being set with open permissions: ugo+rw Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:13 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef Aug 03 08:51:13 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:13 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582" returned: 0 in 0.673s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:14 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 Aug 03 08:51:14 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:14 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef" returned: 0 in 0.406s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b7daa703-3cf0-4abc-90fc-d9bd316c79b8 tempest-SnapshotsActionsTest-1487943296 None] Create snapshot completed successfully Aug 03 08:51:14 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763" returned: 0 in 0.518s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:14 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763 Aug 03 08:51:14 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:14 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582.1a204a24-4cc7-4812-8826-854187837763" returned: 0 in 0.422s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-1a204a24-4cc7-4812-8826-854187837763" released by "_delete_snapshot" :: held 2.556s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" released by "delete_snapshot" :: held 2.624s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-dc9caf56-a590-4056-8a98-163a42f4f7ef-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.quota [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Created reservations ['ffa7322b-cf8b-48a9-88c7-94f42fcd977e', '957432b3-242d-4b8d-b3a5-45c7cedf4e8c', '68aac69b-a5c0-4843-9afb-ecd723ff3b1f', '11b2d805-8caa-4235-9ca1-a886294faa3b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-dc9caf56-a590-4056-8a98-163a42f4f7ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.067s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-dc9caf56-a590-4056-8a98-163a42f4f7ef" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-dc9caf56-a590-4056-8a98-163a42f4f7ef" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Deleting offline snapshot dc9caf56-a590-4056-8a98-163a42f4f7ef of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] snapshot_file for this snap is: volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Delete snapshot completed successfully. Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bf67ae-6cea-493f-b905-e9dee3ff848d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-5171558f-4588-4d0a-9731-57eb318fd389 req-01763c61-fa9a-4672-a052-457c8bdb52d7 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-1a204a24-4cc7-4812-8826-854187837763-delete_snapshot" released by "delete_snapshot" :: held 2.994s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:15 devstack sudo[96453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef Aug 03 08:51:15 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:15 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef" returned: 0 in 0.450s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf255b4-51e6-4370-a52a-3bb46478ceec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "cinder-2d65e062-0bb1-48f8-b280-643382bc3582-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-2d65e062-0bb1-48f8-b280-643382bc3582-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=78,cinder:SELECT=57,cinder:INSERT=20,cinder:DELETE=6 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:15 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:15 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3eb921-3569-476c-bfb8-3abdf8af9614]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:16 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 Aug 03 08:51:16 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:16 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.567s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:16 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef Aug 03 08:51:16 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:16 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:16 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582 Aug 03 08:51:16 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:16 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2d65e062-0bb1-48f8-b280-643382bc3582" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-quobyte-2d65e062-0bb1-48f8-b280-643382bc3582" released by "delete_volume" :: held 0.886s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=74,cinder:UPDATE=75,cinder:INSERT=16,cinder:DELETE=6 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:16 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef" returned: 0 in 0.542s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:16 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef Aug 03 08:51:16 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:16 devstack cinder-volume[88796]: DEBUG cinder.quota [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Created reservations ['de7f5e92-480c-4f83-b839-88e89d790560', 'c3c175b9-fca0-4fd3-9ec0-464548684f7b', 'bb9d0f1e-60ca-4263-8748-b887e649be44', 'c78a8d13-1bb5-41db-abd3-86edc5851547'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:17 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:17 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:17 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.dc9caf56-a590-4056-8a98-163a42f4f7ef" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-dc9caf56-a590-4056-8a98-163a42f4f7ef" released by "_delete_snapshot" :: held 2.044s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_snapshot" :: held 2.092s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Created reservations ['274f65d5-c7ae-4726-af3e-b94338b22576', '3c911b67-d361-497a-b350-20c4de72fc61', '64ab3411-1d03-46e7-9489-04b94dc05a02', '61fb7968-f35d-4d04-a47e-29a0880024f1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:17 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.manager [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Deleted volume successfully. Aug 03 08:51:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Delete snapshot completed successfully. Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-af03d9d8-28b1-4d84-a92a-b9ca9180f63a tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-dc9caf56-a590-4056-8a98-163a42f4f7ef-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-7c122845-5973-4c4a-8162-35af827340b2 req-1679f41b-01bc-4fbe-80fb-919e0b37d690 tempest-VolumesSnapshotsTestJSON-414436316 None] Lock "cinder-2d65e062-0bb1-48f8-b280-643382bc3582-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Creating offline snapshot a5c3082f-485e-43b3-929f-1c508321e28a of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0269907-5075-438b-bd70-5eff58bae816]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:19 devstack sudo[96488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:19 devstack sudo[96488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:19 devstack sudo[96488]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.496s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:19 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a 1G Aug 03 08:51:19 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:20 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a 1G" returned: 0 in 0.569s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:20 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a Aug 03 08:51:20 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:20 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a" returned: 0 in 0.363s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a is being set with open permissions: ugo+rw Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:20 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a Aug 03 08:51:20 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:20 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-410c2a9d-0b6e-4e40-aaf1-42000a0d9071 tempest-SnapshotsActionsTest-1487943296 None] Create snapshot completed successfully Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-a5c3082f-485e-43b3-929f-1c508321e28a-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-a5c3082f-485e-43b3-929f-1c508321e28a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-a5c3082f-485e-43b3-929f-1c508321e28a" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-a5c3082f-485e-43b3-929f-1c508321e28a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Deleting offline snapshot a5c3082f-485e-43b3-929f-1c508321e28a of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] snapshot_file for this snap is: volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02481e-5701-44f4-af91-976a8e639a8f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:21 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a Aug 03 08:51:21 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:21 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a" returned: 0 in 0.431s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb885e3-09af-43ad-9224-de13c6f1e3ff]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:21 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:21 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:22 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.445s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:22 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a Aug 03 08:51:22 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:22 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a" returned: 0 in 0.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:22 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a Aug 03 08:51:22 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:23 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.a5c3082f-485e-43b3-929f-1c508321e28a" returned: 0 in 0.495s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-a5c3082f-485e-43b3-929f-1c508321e28a" released by "_delete_snapshot" :: held 2.042s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_snapshot" :: held 2.072s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Created reservations ['1517266b-7eb0-46b4-a5ec-aae87cbec0b2', 'b4f12d3e-6fdc-43ec-bad1-2875860b2d5c', 'fc71110d-7feb-4ee9-b831-72d45b297e93', '9455720f-cf58-4ef3-ae80-b116aaf95461'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Delete snapshot completed successfully. Aug 03 08:51:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cccffa32-03b3-4bdc-87d8-0672f56bcc8b tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-a5c3082f-485e-43b3-929f-1c508321e28a-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Creating offline snapshot 46d648e6-1c39-4fca-b2a4-0831915531ab of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:51:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[352bd27f-8db0-4025-895f-50ff4fee0eca]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:25 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:25 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:25 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.445s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:25 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab 1G Aug 03 08:51:25 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:26 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab 1G" returned: 0 in 0.720s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:26 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab Aug 03 08:51:26 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:26 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab is being set with open permissions: ugo+rw Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:26 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab Aug 03 08:51:26 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:26 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab" returned: 0 in 0.332s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e198df80-21a5-44e0-a348-f261c65d5923 tempest-SnapshotsActionsTest-1487943296 None] Create snapshot completed successfully Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (d80272b2-c69b-4c8c-94ce-fab801496faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df37436-5bc3-4c16-be9e-7e18b0e8e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df37436-5bc3-4c16-be9e-7e18b0e8e098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287157885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da5035-fed0-46d7-b9c5-628fa68bb2ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:27Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c4ca75-da9a-4c0c-bb2e-ca7e898b0194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c4ca75-da9a-4c0c-bb2e-ca7e898b0194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e603d151-a7ba-483d-a448-d98d1e6cc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e603d151-a7ba-483d-a448-d98d1e6cc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2da5035-fed0-46d7-b9c5-628fa68bb2ce', 'volume_name': 'volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f89e399-646c-46fd-83b4-8b93f5a1b3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f89e399-646c-46fd-83b4-8b93f5a1b3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2986624b-abcb-4727-a679-48a9daf931be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Volume a2da5035-fed0-46d7-b9c5-628fa68bb2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce', 'volume_size': 1} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287157885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2da5035-fed0-46d7-b9c5-628fa68bb2ce,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:27Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Creating volume a2da5035-fed0-46d7-b9c5-628fa68bb2ce {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:27 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce 1073741824 Aug 03 08:51:27 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:27 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce 1073741824" returned: 0 in 0.522s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:27 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce Aug 03 08:51:27 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-46d648e6-1c39-4fca-b2a4-0831915531ab-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Flow 'volume_create_manager' (ebd3c1a8-a1aa-418a-b20b-dd8e73c0c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e069ea-88d9-4192-a3f2-66dd8c462fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e069ea-88d9-4192-a3f2-66dd8c462fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1462059817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c07eac-f790-42cd-9cce-f7eec123a1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f695f04a59459ea7acbcfccc7ac75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:28Z,use_quota=True,user_id='8713d485795045bd94b97b092d20f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0452f56-9e6b-41df-839c-90e0a040c4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0452f56-9e6b-41df-839c-90e0a040c4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4054af16-e781-4366-af51-981ac7f1ef20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4054af16-e781-4366-af51-981ac7f1ef20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c07eac-f790-42cd-9cce-f7eec123a1d1', 'volume_name': 'volume-01c07eac-f790-42cd-9cce-f7eec123a1d1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636479f4-c568-45f2-a7fd-237e282008f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636479f4-c568-45f2-a7fd-237e282008f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd9472d-206c-4aa2-8ffb-259bbec703c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Volume 01c07eac-f790-42cd-9cce-f7eec123a1d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c07eac-f790-42cd-9cce-f7eec123a1d1', 'volume_size': 1} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1462059817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c07eac-f790-42cd-9cce-f7eec123a1d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f695f04a59459ea7acbcfccc7ac75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:28Z,use_quota=True,user_id='8713d485795045bd94b97b092d20f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Creating volume 01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:28 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-46d648e6-1c39-4fca-b2a4-0831915531ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.130s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2986624b-abcb-4727-a679-48a9daf931be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac99012-b16f-4816-b237-889e5197306c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:28 devstack sudo[96559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 1073741824 Aug 03 08:51:28 devstack sudo[96559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Acquiring lock "cinder-quobyte-46d648e6-1c39-4fca-b2a4-0831915531ab" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Volume volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce (a2da5035-fed0-46d7-b9c5-628fa68bb2ce): created successfully Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac99012-b16f-4816-b237-889e5197306c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (d80272b2-c69b-4c8c-94ce-fab801496faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-46d648e6-1c39-4fca-b2a4-0831915531ab" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Deleting offline snapshot 46d648e6-1c39-4fca-b2a4-0831915531ab of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] snapshot_file for this snap is: volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6b3db621-6dff-4f94-8a1d-8288617c7b71 tempest-VolumesTestJSON-478024141 None] Created volume successfully. Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7daff9-46f9-463c-93e8-d26d1d7e1643]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:28 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab Aug 03 08:51:28 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:29 devstack sudo[96559]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:29 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 1073741824" returned: 0 in 0.631s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab" returned: 0 in 0.508s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8967a-826f-409a-8136-0fad6b3dc5e1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:29 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:51:29 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:29 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:29 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:29 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd9472d-206c-4aa2-8ffb-259bbec703c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c07eac-f790-42cd-9cce-f7eec123a1d1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f167ad3-8b67-4d09-815f-343ec48d3135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Volume volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 (01c07eac-f790-42cd-9cce-f7eec123a1d1): created successfully Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f167ad3-8b67-4d09-815f-343ec48d3135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:29 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Flow 'volume_create_manager' (ebd3c1a8-a1aa-418a-b20b-dd8e73c0c94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.613s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c4398af8-19fb-432a-9341-8a21c845f411 tempest-TestStampPattern-1987295736 None] Created volume successfully. Aug 03 08:51:29 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab Aug 03 08:51:29 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:30 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab" returned: 0 in 0.528s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:30 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab Aug 03 08:51:30 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (acfdc949-2bdd-45be-a7a2-56cf34bd43c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14da729b-0a49-4ceb-af15-502ce6752dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14da729b-0a49-4ceb-af15-502ce6752dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925853682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf6d7ae-73c9-4367-a707-ec40e3556dd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:30Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31f9d56-44e1-4157-a222-a883cd3b6ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b31f9d56-44e1-4157-a222-a883cd3b6ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064d1b9-3e1d-40e4-9191-b206712d2dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a064d1b9-3e1d-40e4-9191-b206712d2dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cf6d7ae-73c9-4367-a707-ec40e3556dd3', 'volume_name': 'volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:30 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcea9da5-d779-4f0c-b0db-c3adaf766875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcea9da5-d779-4f0c-b0db-c3adaf766875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af314637-ade5-45dc-9cb7-15e3926fb2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Volume 0cf6d7ae-73c9-4367-a707-ec40e3556dd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3', 'volume_size': 1} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1925853682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cf6d7ae-73c9-4367-a707-ec40e3556dd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:30Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Creating volume 0cf6d7ae-73c9-4367-a707-ec40e3556dd3 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.46d648e6-1c39-4fca-b2a4-0831915531ab" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:30 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 1073741824 Aug 03 08:51:30 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-46d648e6-1c39-4fca-b2a4-0831915531ab" released by "_delete_snapshot" :: held 2.242s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_snapshot" :: held 2.286s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Created reservations ['234f970b-2e72-4c63-8ca4-4d87184a4157', 'b9f5cec3-5cc8-4361-9c96-2dda58054c0b', 'ca59e0f8-6241-4507-847c-6b69eb80d9ba', 'c336d421-5d17-4626-acaa-df275fbb15d5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Delete snapshot completed successfully. Aug 03 08:51:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c11b6ad-8fb0-44dd-aea5-d4d5db208e71 tempest-SnapshotsActionsTest-1253603779 None] Lock "cinder-46d648e6-1c39-4fca-b2a4-0831915531ab-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:31 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 1073741824" returned: 0 in 0.675s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:31 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 Aug 03 08:51:31 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:31 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" returned: 0 in 0.402s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af314637-ade5-45dc-9cb7-15e3926fb2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b43af19-a597-489c-b2aa-3f5811f15ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Volume volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 (0cf6d7ae-73c9-4367-a707-ec40e3556dd3): created successfully Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b43af19-a597-489c-b2aa-3f5811f15ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (acfdc949-2bdd-45be-a7a2-56cf34bd43c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-baf2779d-2532-424e-ac53-4df3b367a61a tempest-VolumesTestJSON-478024141 None] Created volume successfully. Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "cinder-9ffde5b0-ccc2-4e74-a724-c815e706d3a2-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-9ffde5b0-ccc2-4e74-a724-c815e706d3a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "cinder-quobyte-9ffde5b0-ccc2-4e74-a724-c815e706d3a2" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-9ffde5b0-ccc2-4e74-a724-c815e706d3a2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Deleting offline snapshot 9ffde5b0-ccc2-4e74-a724-c815e706d3a2 of volume 6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] snapshot_file for this snap is: volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[41426dcd-25ff-4457-8001-fe7473576b26]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:32 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:32 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:33 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.623s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7a23ef-62b6-444a-9025-33484e52b93d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:33 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c Aug 03 08:51:33 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (6b51c2e5-f4fe-462b-85ee-2994f0e53a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c52cd4b-86cf-4436-9dc7-85f494152e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c52cd4b-86cf-4436-9dc7-85f494152e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1228933023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2c437d-f5dc-4f2b-8642-8d44213ee66e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:33Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29ff7cd-e8f5-4ece-b40d-a6d263c9c37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b29ff7cd-e8f5-4ece-b40d-a6d263c9c37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d06f0a-48ea-4554-b04f-fec566884507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d06f0a-48ea-4554-b04f-fec566884507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed2c437d-f5dc-4f2b-8642-8d44213ee66e', 'volume_name': 'volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fc0892-4465-43a2-970e-abe3359a1862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fc0892-4465-43a2-970e-abe3359a1862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2133294e-5fe5-4b1b-bc4a-449dcf50c776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:33 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Volume ed2c437d-f5dc-4f2b-8642-8d44213ee66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e', 'volume_size': 1} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1228933023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed2c437d-f5dc-4f2b-8642-8d44213ee66e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8118b735ab2547ac850e1402effdef19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:33Z,use_quota=True,user_id='26a7855124094615843b095e30129604',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Creating volume ed2c437d-f5dc-4f2b-8642-8d44213ee66e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:33 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:33 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" returned: 0 in 0.458s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:33 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e 1073741824 Aug 03 08:51:33 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:33 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:33 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:34 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:34 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2 Aug 03 08:51:34 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:34 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e 1073741824" returned: 0 in 0.678s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:34 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e Aug 03 08:51:34 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:34 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c.9ffde5b0-ccc2-4e74-a724-c815e706d3a2" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-9ffde5b0-ccc2-4e74-a724-c815e706d3a2" released by "_delete_snapshot" :: held 2.114s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_snapshot" :: held 2.155s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Created reservations ['b9d67bc3-b539-4e47-9ccd-4a45421bfee1', '42573f17-4248-45ee-8567-c0a3b3c60927', '059e9eca-d416-48ed-9a7c-cc8820097563', '9e35520d-35c5-4572-b9e6-50c9381140c6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:34 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" returned: 0 in 0.474s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Delete snapshot completed successfully. Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-93846771-22fd-4d60-b920-2f7839223214 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-9ffde5b0-ccc2-4e74-a724-c815e706d3a2-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2133294e-5fe5-4b1b-bc4a-449dcf50c776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19833de-14a2-49bc-b488-7ee94b58ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Volume volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e (ed2c437d-f5dc-4f2b-8642-8d44213ee66e): created successfully Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19833de-14a2-49bc-b488-7ee94b58ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Flow 'volume_create_manager' (6b51c2e5-f4fe-462b-85ee-2994f0e53a35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2a2a84f6-a152-41bb-9f8f-2d45e002016e tempest-VolumesTestJSON-478024141 None] Created volume successfully. Aug 03 08:51:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "cinder-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" acquired by "delete_volume" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1396e99-f0bf-436a-8491-7b3096fa9db6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:36 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c Aug 03 08:51:36 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:36 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" returned: 0 in 0.744s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:36 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c Aug 03 08:51:36 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:37 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-quobyte-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c" released by "delete_volume" :: held 1.314s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Created reservations ['64401452-9dbe-4534-bbe3-ea4f06e6150c', '2d3a8dd3-0ed5-492c-8dcb-c64108cb0103', '589d3488-35a5-47da-9389-5ba088e490bc', '861455eb-8091-4b68-8fff-89a2369122d3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:37 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:37 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-ed2c437d-f5dc-4f2b-8642-8d44213ee66e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "cinder-ed2c437d-f5dc-4f2b-8642-8d44213ee66e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-quobyte-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e8a6d8-cbca-466f-a472-01c1e6858705]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:38 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e Aug 03 08:51:38 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:38 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.619s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:38 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Deleted volume successfully. Aug 03 08:51:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1ad87df4-0aba-435f-94d8-7fd8567e75a4 tempest-SnapshotsActionsTest-1487943296 None] Lock "cinder-6de4d2ea-4dae-42e0-87f0-c1c6e868e91c-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:38 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" returned: 0 in 0.817s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:38 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e Aug 03 08:51:38 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:39 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" returned: 0 in 0.538s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-ed2c437d-f5dc-4f2b-8642-8d44213ee66e" released by "delete_volume" :: held 1.418s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Created reservations ['c5e84b22-6348-4131-a032-79c8915dd36d', '4630af29-cf15-4fcf-bd25-42949b05da35', '325080fd-ff5f-49e2-a501-2300ad06552a', '2b0557eb-f7da-4d0b-aa24-fb626bb30ddb'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:39 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:39 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:40 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.437s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Deleted volume successfully. Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8c908cfe-0d5d-4801-b3ea-d8723b5f6483 tempest-VolumesTestJSON-478024141 None] Lock "cinder-ed2c437d-f5dc-4f2b-8642-8d44213ee66e-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-0cf6d7ae-73c9-4367-a707-ec40e3556dd3-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "cinder-0cf6d7ae-73c9-4367-a707-ec40e3556dd3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-quobyte-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8b78d6-6eec-4aa9-8337-403a396d1b22]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:40 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 Aug 03 08:51:40 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:41 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" returned: 0 in 0.802s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:41 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3 Aug 03 08:51:41 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:41 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-0cf6d7ae-73c9-4367-a707-ec40e3556dd3" released by "delete_volume" :: held 1.255s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Created reservations ['cf6eac1b-924f-4e63-a722-83540af72dff', '5a7916ed-f849-4d29-9d89-bccbec229169', '2b3631ae-4fc7-4b38-acd9-50ddf1594c03', '4b4784b3-2356-4bed-b166-c4e17f861a39'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:41 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:41 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:42 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Deleted volume successfully. Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-788d888c-212d-4418-9ea5-6b1df73903f4 tempest-VolumesTestJSON-478024141 None] Lock "cinder-0cf6d7ae-73c9-4367-a707-ec40e3556dd3-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-a2da5035-fed0-46d7-b9c5-628fa68bb2ce-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "cinder-a2da5035-fed0-46d7-b9c5-628fa68bb2ce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Acquiring lock "cinder-quobyte-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:51:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:51:43 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[493107eb-456b-411b-8ca4-785324010732]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:51:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:43 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce Aug 03 08:51:43 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:43 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" returned: 0 in 0.792s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:43 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce Aug 03 08:51:43 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:44 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" returned: 0 in 0.694s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "cinder-quobyte-a2da5035-fed0-46d7-b9c5-628fa68bb2ce" released by "delete_volume" :: held 1.568s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Created reservations ['30e8e0a8-f59c-4830-a2a9-5b6b9cc81e27', 'cb23c3d7-7efb-4e6f-96ad-42cf1970119e', '97e65ea8-e57d-42be-916b-4127fe925fea', '0c0c23ac-2b7a-4bf9-a800-da91b234a559'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:44 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:51:44 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:45 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.470s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:51:45 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:51:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Deleted volume successfully. Aug 03 08:51:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-79767ab2-14de-4783-81ba-844af210db0e tempest-VolumesTestJSON-478024141 None] Lock "cinder-a2da5035-fed0-46d7-b9c5-628fa68bb2ce-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:51:54 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=55,cinder:INSERT=20,cinder:UPDATE=84,cinder:DELETE=6 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:55 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:INSERT=20,cinder:UPDATE=67,cinder:SELECT=56,cinder:DELETE=5 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:51:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c840c9f0-d5e5-49f5-8ade-2038ed64c239 tempest-GroupsV320Test-472709017 None] Group tempest-GroupsV320Test-Group-512437755: creating Aug 03 08:51:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c840c9f0-d5e5-49f5-8ade-2038ed64c239 tempest-GroupsV320Test-472709017 None] Group tempest-GroupsV320Test-Group-512437755: created successfully Aug 03 08:51:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c840c9f0-d5e5-49f5-8ade-2038ed64c239 tempest-GroupsV320Test-472709017 None] Create group completed successfully. Aug 03 08:51:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:51:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Flow 'volume_create_manager' (7c24b343-ff29-4d96-af5d-d637e90b42bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86ae444-ca1d-4b6a-aa0a-3a1710703855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b86ae444-ca1d-4b6a-aa0a-3a1710703855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-161078357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e867b73b-9c31-4490-8181-cc03a1189fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203fca9277c2464baa93f5a25822bd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:59Z,use_quota=True,user_id='a9e955a7e46f47f898f9f663b692c9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d94e1844-92cc-429f-a5c4-82590bf21ce3),volume_type_id=d94e1844-92cc-429f-a5c4-82590bf21ce3)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec6c77c-2336-47f3-82c0-ca2523d52fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec6c77c-2336-47f3-82c0-ca2523d52fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08a15a1-6e40-4b0b-955e-fca952608ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f08a15a1-6e40-4b0b-955e-fca952608ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e867b73b-9c31-4490-8181-cc03a1189fdb', 'volume_name': 'volume-e867b73b-9c31-4490-8181-cc03a1189fdb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4f60e-2e2a-47ae-a033-aa50bbf615a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c4f60e-2e2a-47ae-a033-aa50bbf615a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcbd887-dab2-4376-a903-96ad909e3a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:51:59 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Volume e867b73b-9c31-4490-8181-cc03a1189fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e867b73b-9c31-4490-8181-cc03a1189fdb', 'volume_size': 1} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-161078357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e867b73b-9c31-4490-8181-cc03a1189fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='203fca9277c2464baa93f5a25822bd6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:51:59Z,use_quota=True,user_id='a9e955a7e46f47f898f9f663b692c9e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d94e1844-92cc-429f-a5c4-82590bf21ce3),volume_type_id=d94e1844-92cc-429f-a5c4-82590bf21ce3)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Creating volume e867b73b-9c31-4490-8181-cc03a1189fdb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:51:59 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:51:59 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb 1073741824 Aug 03 08:51:59 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:51:59 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Aug 03 08:51:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb 1073741824" returned: 0 in 0.827s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:00 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb Aug 03 08:52:00 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:00 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb" returned: 0 in 0.488s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcbd887-dab2-4376-a903-96ad909e3a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e867b73b-9c31-4490-8181-cc03a1189fdb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aff000-6ccf-4253-9e74-f68d8365fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:00 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Volume volume-e867b73b-9c31-4490-8181-cc03a1189fdb (e867b73b-9c31-4490-8181-cc03a1189fdb): created successfully Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aff000-6ccf-4253-9e74-f68d8365fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Flow 'volume_create_manager' (7c24b343-ff29-4d96-af5d-d637e90b42bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-61258ee2-0d5a-4ad4-b4c8-7aa6c614bc32 tempest-VolumeTypesAccessTest-1630184305 None] Created volume successfully. Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Created reservations ['fdfda677-b27d-456b-b771-bf63f88aa570'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:00 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:00 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:01 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9290d8f6-18d0-4c70-9fe0-6ca9800b1bbc tempest-GroupsV320Test-472709017 None] Delete group completed successfully. Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Acquiring lock "cinder-e867b73b-9c31-4490-8181-cc03a1189fdb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "cinder-e867b73b-9c31-4490-8181-cc03a1189fdb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Acquiring lock "cinder-quobyte-e867b73b-9c31-4490-8181-cc03a1189fdb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "cinder-quobyte-e867b73b-9c31-4490-8181-cc03a1189fdb" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6f2669-5bb7-47ee-96ef-776dbc469bbe]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:01 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb Aug 03 08:52:01 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:02 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb" returned: 0 in 0.625s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:02 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb Aug 03 08:52:02 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:02 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e867b73b-9c31-4490-8181-cc03a1189fdb" returned: 0 in 0.430s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "cinder-quobyte-e867b73b-9c31-4490-8181-cc03a1189fdb" released by "delete_volume" :: held 1.152s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:02 devstack cinder-volume[88796]: WARNING cinder.quota [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-310262203 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-310262203, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:52:02 devstack cinder-volume[88796]: WARNING cinder.quota [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-310262203 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-310262203, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Created reservations ['2aff916c-7e72-4383-98eb-bb7dcff8c216', '7d5cd44d-6b99-45f0-97d4-2136bdb0d31a', '0052fb39-b835-494a-bb52-08378f89b30e', '4b6eae5d-d5eb-4139-81c7-572661f409df'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:02 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:02 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:03 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:03 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Deleted volume successfully. Aug 03 08:52:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a2fc0f5f-0c30-421a-bbf3-c7701d1d4032 tempest-VolumeTypesAccessTest-1630184305 None] Lock "cinder-e867b73b-9c31-4490-8181-cc03a1189fdb-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8b25c626-91ca-471a-8506-dce597a9e54b req-8a44a0cf-b508-43be-bd51-74623204d5c2 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8b25c626-91ca-471a-8506-dce597a9e54b req-8a44a0cf-b508-43be-bd51-74623204d5c2 tempest-TestStampPattern-1987295736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8b25c626-91ca-471a-8506-dce597a9e54b req-8a44a0cf-b508-43be-bd51-74623204d5c2 tempest-TestStampPattern-1987295736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.057s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-8b25c626-91ca-471a-8506-dce597a9e54b req-8a44a0cf-b508-43be-bd51-74623204d5c2 tempest-TestStampPattern-1987295736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-01c07eac-f790-42cd-9cce-f7eec123a1d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '334142a7-d731-4b65-992e-f1542d426538', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:08 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:08 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-8b25c626-91ca-471a-8506-dce597a9e54b req-8a44a0cf-b508-43be-bd51-74623204d5c2 tempest-TestStampPattern-1987295736 None] attachment_update completed successfully. Aug 03 08:52:09 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.858s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:52:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:52:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:52:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-06b07b06-b2e4-488e-b8c1-23dedbae8829 req-84ab6aaf-cc92-47da-8732-6209693bd843 tempest-TestStampPattern-1987295736 None] Terminate volume connection completed successfully. Aug 03 08:52:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-06b07b06-b2e4-488e-b8c1-23dedbae8829 req-84ab6aaf-cc92-47da-8732-6209693bd843 tempest-TestStampPattern-1987295736 None] Deleting attachment 334142a7-d731-4b65-992e-f1542d426538. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:52:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Creating offline snapshot ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 of volume 01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:52:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da96eb1-ae93-4a01-92ee-dd82c30adc9e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:18 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:52:18 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:19 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.683s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:19 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 1G Aug 03 08:52:19 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Flow 'volume_create_manager' (ab403092-4964-4459-928a-f2985a7e2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c866abb-8b7f-486d-b526-a7a45f8d342e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c866abb-8b7f-486d-b526-a7a45f8d342e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-835027261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea1d1d5-e147-4a9f-8584-01a802120c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c005c80fd41a4c61957de83a54ca71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:19Z,use_quota=True,user_id='efe527e79a854bafb11aa18b9a601f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb33036-0522-4b22-b998-e47da496f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb33036-0522-4b22-b998-e47da496f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24e6312-a43f-4932-ad16-36068362fa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24e6312-a43f-4932-ad16-36068362fa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea1d1d5-e147-4a9f-8584-01a802120c3f', 'volume_name': 'volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a856d3-00b6-4710-80f5-da1eeaa50205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a856d3-00b6-4710-80f5-da1eeaa50205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a4e22c-a1c3-4aea-921a-dedb3e100a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:19 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Volume 1ea1d1d5-e147-4a9f-8584-01a802120c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f', 'volume_size': 1} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:19 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 1G" returned: 0 in 0.796s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:19 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:52:19 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:20 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.402s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 is being set with open permissions: ugo+rw Aug 03 08:52:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:20 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:52:20 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:20 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.501s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:20 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info Aug 03 08:52:20 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:21 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info is being set with open permissions: ugo+rw Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:21 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info Aug 03 08:52:21 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:21 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.info" returned: 0 in 0.363s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.224s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.279s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-835027261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea1d1d5-e147-4a9f-8584-01a802120c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c005c80fd41a4c61957de83a54ca71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:19Z,use_quota=True,user_id='efe527e79a854bafb11aa18b9a601f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Creating volume 1ea1d1d5-e147-4a9f-8584-01a802120c3f {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:52:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:21 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f 1073741824 Aug 03 08:52:21 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2632425b-616d-440e-bae9-caa603fb2549 tempest-TestStampPattern-1987295736 None] Create snapshot completed successfully Aug 03 08:52:22 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f 1073741824" returned: 0 in 0.534s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:22 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f Aug 03 08:52:22 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:22 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a4e22c-a1c3-4aea-921a-dedb3e100a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3e960-1c2f-4544-987c-2a68c1de5f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Volume volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f (1ea1d1d5-e147-4a9f-8584-01a802120c3f): created successfully Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e3e960-1c2f-4544-987c-2a68c1de5f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Flow 'volume_create_manager' (ab403092-4964-4459-928a-f2985a7e2015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c28eb17d-4762-46af-a798-220b719ad883 tempest-ServersNegativeTestJSON-1749038200 None] Created volume successfully. Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Flow 'volume_create_manager' (4e5759bf-ec5f-44a2-bd77-09bef304d210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b881d28b-666c-4337-9f05-191be3c82091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b881d28b-666c-4337-9f05-191be3c82091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1403734426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e7515-e995-4001-b92e-8afa0d92af9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c005c80fd41a4c61957de83a54ca71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:25Z,use_quota=True,user_id='efe527e79a854bafb11aa18b9a601f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afef91c-2358-49f9-8149-982b1ba5fb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afef91c-2358-49f9-8149-982b1ba5fb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23897dcd-a5f4-4db4-9b60-f88ae95befc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23897dcd-a5f4-4db4-9b60-f88ae95befc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0e7515-e995-4001-b92e-8afa0d92af9c', 'volume_name': 'volume-5a0e7515-e995-4001-b92e-8afa0d92af9c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695bed38-322d-43c2-bbc0-e8ad9f8749c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695bed38-322d-43c2-bbc0-e8ad9f8749c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833724c7-22ae-4216-ace8-d51b11e38779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Volume 5a0e7515-e995-4001-b92e-8afa0d92af9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0e7515-e995-4001-b92e-8afa0d92af9c', 'volume_size': 1} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1403734426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0e7515-e995-4001-b92e-8afa0d92af9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c005c80fd41a4c61957de83a54ca71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:25Z,use_quota=True,user_id='efe527e79a854bafb11aa18b9a601f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Creating volume 5a0e7515-e995-4001-b92e-8afa0d92af9c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:52:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:25 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c 1073741824 Aug 03 08:52:25 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:25 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c 1073741824" returned: 0 in 0.585s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:26 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c Aug 03 08:52:26 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:26 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (833724c7-22ae-4216-ace8-d51b11e38779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0e7515-e995-4001-b92e-8afa0d92af9c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f37f40c-3116-477d-8e36-ad72301de1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Volume volume-5a0e7515-e995-4001-b92e-8afa0d92af9c (5a0e7515-e995-4001-b92e-8afa0d92af9c): created successfully Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f37f40c-3116-477d-8e36-ad72301de1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Flow 'volume_create_manager' (4e5759bf-ec5f-44a2-bd77-09bef304d210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d25e5720-6da4-4fb9-a5a2-4840aad749fc tempest-ServersNegativeTestJSON-1749038200 None] Created volume successfully. Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "cinder-5a0e7515-e995-4001-b92e-8afa0d92af9c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-5a0e7515-e995-4001-b92e-8afa0d92af9c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "cinder-quobyte-5a0e7515-e995-4001-b92e-8afa0d92af9c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-quobyte-5a0e7515-e995-4001-b92e-8afa0d92af9c" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe76186-302d-4ee3-9da9-2a2e58293657]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:28 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c Aug 03 08:52:28 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:28 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:28 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c Aug 03 08:52:28 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:29 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a0e7515-e995-4001-b92e-8afa0d92af9c" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-quobyte-5a0e7515-e995-4001-b92e-8afa0d92af9c" released by "delete_volume" :: held 0.830s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Created reservations ['444572da-b164-4ca9-beaf-3abe27a94069', 'f5c39692-a73d-4e64-ae1c-ec3b88671a81', '66cc5682-6665-46bf-9875-badc6cdcbb6b', 'fedfcf5c-3fd2-497b-ba6c-75575ba15991'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:29 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:29 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "cinder-1ea1d1d5-e147-4a9f-8584-01a802120c3f-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-1ea1d1d5-e147-4a9f-8584-01a802120c3f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "cinder-quobyte-1ea1d1d5-e147-4a9f-8584-01a802120c3f" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-quobyte-1ea1d1d5-e147-4a9f-8584-01a802120c3f" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d042e30e-e9fe-47fa-adbd-a550746b90a8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:29 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.405s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Deleted volume successfully. Aug 03 08:52:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4122e9a7-6980-481d-ba08-affed1bf0004 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-5a0e7515-e995-4001-b92e-8afa0d92af9c-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:30 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f Aug 03 08:52:30 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:30 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f" returned: 0 in 0.708s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:30 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f Aug 03 08:52:30 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:30 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1ea1d1d5-e147-4a9f-8584-01a802120c3f" returned: 0 in 0.480s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-quobyte-1ea1d1d5-e147-4a9f-8584-01a802120c3f" released by "delete_volume" :: held 1.278s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Created reservations ['9593f197-832d-4bbf-a814-051b7aa45a09', '80efee8f-f5e3-44e7-bc9e-00ef314e8460', '36e470d8-7a33-4fc7-91a5-2796697a0b53', '3fb68b10-65a9-4b30-b93d-3807e7684660'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:31 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:31 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:31 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.316s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Deleted volume successfully. Aug 03 08:52:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51e8e100-ff32-4476-8036-ea3a726ab188 tempest-ServersNegativeTestJSON-1749038200 None] Lock "cinder-1ea1d1d5-e147-4a9f-8584-01a802120c3f-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Flow 'volume_create_manager' (6fd9a16c-520d-447f-ae9d-6064aea712c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dd3134-bfd5-4e30-9580-0facb9c4042d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75dd3134-bfd5-4e30-9580-0facb9c4042d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4256665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dc4981-8239-4fba-9b0e-92c1dde39adc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54f695f04a59459ea7acbcfccc7ac75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:32Z,use_quota=True,user_id='8713d485795045bd94b97b092d20f8f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957e00b2-a994-4186-8df3-4b04e872a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957e00b2-a994-4186-8df3-4b04e872a432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbb967f-e0e9-4d58-b6c3-0aac568ffb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfbb967f-e0e9-4d58-b6c3-0aac568ffb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a7dc4981-8239-4fba-9b0e-92c1dde39adc', 'volume_name': 'volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc', 'volume_size': 1, 'snapshot_id': 'ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1443f4-ab94-4a96-b80d-d55f1ab6b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1443f4-ab94-4a96-b80d-d55f1ab6b516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010c866a-d600-45b1-9992-242783822eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Volume a7dc4981-8239-4fba-9b0e-92c1dde39adc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc', 'volume_size': 1, 'snapshot_id': 'ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2'} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-a7dc4981-8239-4fba-9b0e-92c1dde39adc" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-a7dc4981-8239-4fba-9b0e-92c1dde39adc" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Creating volume a7dc4981-8239-4fba-9b0e-92c1dde39adc from snapshot ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] snapshot: ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2, volume: a7dc4981-8239-4fba-9b0e-92c1dde39adc, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1fe33c-4882-47ed-bf45-b9222d376d1e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:32 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:52:32 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.699s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01c07eac-f790-42cd-9cce-f7eec123a1d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:52:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[980375b5-bf5c-41b6-a10d-a19577f692d2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:33 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:52:33 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:33 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.518s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:52:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:52:34 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:52:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:34 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc Aug 03 08:52:34 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:42 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc" returned: 0 in 8.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:52:42 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Converted 1024.00 MB image at 123.95 MB/s Aug 03 08:52:42 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc is being set with open permissions: ugo+rw Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:42 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc Aug 03 08:52:42 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=41,cinder:SELECT=38,cinder:INSERT=8,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Flow 'volume_create_manager' (171927af-74eb-49b3-9cc3-c098a8fc57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50afbbe-e92f-4c18-ada5-f83fef9b9656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50afbbe-e92f-4c18-ada5-f83fef9b9656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1063068147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c537f4a1-3ac9-461d-8aaf-253f47e160b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdad12df26a4d768eeff41555d9711f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:43Z,use_quota=True,user_id='6b5226f1ab1a416888793fc0d08459c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4461839-0290-4c46-9916-48e9c710b659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4461839-0290-4c46-9916-48e9c710b659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b538078-87c8-46ff-b8a7-945e31ad917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b538078-87c8-46ff-b8a7-945e31ad917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c537f4a1-3ac9-461d-8aaf-253f47e160b6', 'volume_name': 'volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e39ce22-c0f9-4d02-974f-c82a4ffc95f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e39ce22-c0f9-4d02-974f-c82a4ffc95f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a57ab3b-f770-4679-9a5a-57709b425890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Volume c537f4a1-3ac9-461d-8aaf-253f47e160b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6', 'volume_size': 1} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:42 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc" returned: 0 in 0.556s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" released by "_copy_volume_from_snapshot" :: held 10.192s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-a7dc4981-8239-4fba-9b0e-92c1dde39adc" released by "_create_volume_from_snapshot" :: held 10.341s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.370s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1063068147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c537f4a1-3ac9-461d-8aaf-253f47e160b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bdad12df26a4d768eeff41555d9711f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:43Z,use_quota=True,user_id='6b5226f1ab1a416888793fc0d08459c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Creating volume c537f4a1-3ac9-461d-8aaf-253f47e160b6 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:42 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:52:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:43 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 1073741824 Aug 03 08:52:43 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010c866a-d600-45b1-9992-242783822eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc', 'volume_size': 1, 'snapshot_id': 'ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4a7f2b-e7a6-4b9b-a14e-8a4bcfb4db43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Volume volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc (a7dc4981-8239-4fba-9b0e-92c1dde39adc): created successfully Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e4a7f2b-e7a6-4b9b-a14e-8a4bcfb4db43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Flow 'volume_create_manager' (6fd9a16c-520d-447f-ae9d-6064aea712c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5a74d27b-c627-4a2f-8bce-3953992c192d tempest-TestStampPattern-1987295736 None] Created volume successfully. Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Flow 'volume_create_manager' (279061af-d325-40d4-b124-9b3d94561eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305606d8-27ab-4a3a-ac4c-61692161309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (305606d8-27ab-4a3a-ac4c-61692161309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-831942834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294ca372-a8c7-41e0-8f0b-6cd387d343ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e73d3132b4886b78e6a23bc1a44c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:43Z,use_quota=True,user_id='ea72de703c784fcabde3e3ca9a62cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d166f08-d191-4fb9-abf6-256895943c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d166f08-d191-4fb9-abf6-256895943c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5330dd46-69b3-4e28-b35b-c8c50bd7684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5330dd46-69b3-4e28-b35b-c8c50bd7684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294ca372-a8c7-41e0-8f0b-6cd387d343ea', 'volume_name': 'volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfcbcac-b61d-4602-b1a4-9885a3382997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcfcbcac-b61d-4602-b1a4-9885a3382997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad0150b-84ab-42e8-a057-d89348e277b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Volume 294ca372-a8c7-41e0-8f0b-6cd387d343ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea', 'volume_size': 1} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:43 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 1073741824" returned: 0 in 0.791s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:43 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 Aug 03 08:52:43 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:44 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-831942834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294ca372-a8c7-41e0-8f0b-6cd387d343ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='326e73d3132b4886b78e6a23bc1a44c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:52:43Z,use_quota=True,user_id='ea72de703c784fcabde3e3ca9a62cf13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Creating volume 294ca372-a8c7-41e0-8f0b-6cd387d343ea {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:52:44 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a57ab3b-f770-4679-9a5a-57709b425890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0420a4-a7ef-4dad-91ee-136b694997a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:44 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea 1073741824 Aug 03 08:52:44 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Volume volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 (c537f4a1-3ac9-461d-8aaf-253f47e160b6): created successfully Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d0420a4-a7ef-4dad-91ee-136b694997a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Flow 'volume_create_manager' (171927af-74eb-49b3-9cc3-c098a8fc57df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-515a28f4-5f43-4949-a931-70f59411d14b tempest-VolumeQuotasNegativeTestJSON-169666347 None] Created volume successfully. Aug 03 08:52:44 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea 1073741824" returned: 0 in 0.756s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:45 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea Aug 03 08:52:45 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:45 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea" returned: 0 in 0.339s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad0150b-84ab-42e8-a057-d89348e277b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f414e9a-c7d3-4917-ac91-819bf15b81f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:52:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Volume volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea (294ca372-a8c7-41e0-8f0b-6cd387d343ea): created successfully Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f414e9a-c7d3-4917-ac91-819bf15b81f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:52:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Flow 'volume_create_manager' (279061af-d325-40d4-b124-9b3d94561eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:52:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3a75901f-1dcb-4ba1-aa23-951b7e502c77 tempest-AbsoluteLimitsTests-727895769 None] Created volume successfully. Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Acquiring lock "cinder-c537f4a1-3ac9-461d-8aaf-253f47e160b6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "cinder-c537f4a1-3ac9-461d-8aaf-253f47e160b6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Acquiring lock "cinder-quobyte-c537f4a1-3ac9-461d-8aaf-253f47e160b6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "cinder-quobyte-c537f4a1-3ac9-461d-8aaf-253f47e160b6" acquired by "delete_volume" :: waited 0.041s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b75ee4-24ad-43ee-ac71-1c3d3f830dd6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Acquiring lock "cinder-294ca372-a8c7-41e0-8f0b-6cd387d343ea-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "cinder-294ca372-a8c7-41e0-8f0b-6cd387d343ea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:47 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 Aug 03 08:52:47 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Acquiring lock "cinder-quobyte-294ca372-a8c7-41e0-8f0b-6cd387d343ea" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "cinder-quobyte-294ca372-a8c7-41e0-8f0b-6cd387d343ea" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[27adc49e-f9a4-4c20-84ac-3f23a8426bff]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea Aug 03 08:52:47 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:47 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6" returned: 0 in 0.812s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6 Aug 03 08:52:47 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:47 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea" returned: 0 in 0.580s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:47 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea Aug 03 08:52:47 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:48 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c537f4a1-3ac9-461d-8aaf-253f47e160b6" returned: 0 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "cinder-quobyte-c537f4a1-3ac9-461d-8aaf-253f47e160b6" released by "delete_volume" :: held 1.281s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:48 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Created reservations ['ce7c04c9-e2d2-4868-b2c3-2d4ec0efbcc7', 'f878041d-1146-4625-9726-f0c278717f2f', '6ecbea93-7b77-48fd-935d-627c7c81d37d', '6d6aa393-939d-44a5-bbca-f46281bdc459'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-294ca372-a8c7-41e0-8f0b-6cd387d343ea" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "cinder-quobyte-294ca372-a8c7-41e0-8f0b-6cd387d343ea" released by "delete_volume" :: held 1.009s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Created reservations ['23263673-828c-4bd2-b255-c4e6b9ce9eea', '1af0017c-27dd-4e60-96bf-ede7cb461a7e', '1c18c437-87e0-4da9-9ba0-9cdb40b653bb', '58d97b4d-7c36-4457-a951-70e8298c2b0a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:48 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:48 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:52:48 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:52:48 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:52:48 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.339s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Deleted volume successfully. Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cf43f769-9c8a-430c-978e-5de86884f167 tempest-VolumeQuotasNegativeTestJSON-169666347 None] Lock "cinder-c537f4a1-3ac9-461d-8aaf-253f47e160b6-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:48 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.452s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:52:48 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:52:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Deleted volume successfully. Aug 03 08:52:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c971abd1-0c76-4224-8dc0-81bbbefd937b tempest-AbsoluteLimitsTests-727895769 None] Lock "cinder-294ca372-a8c7-41e0-8f0b-6cd387d343ea-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:52:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:52:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=57,cinder:UPDATE=65,cinder:INSERT=14,cinder:DELETE=8 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:53:00 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Flow 'volume_create_manager' (f909d304-1a09-4fbf-b420-9893af431239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f21f6e0-048d-49ff-a8c7-e882a6f7cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f21f6e0-048d-49ff-a8c7-e882a6f7cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-955007864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a830a2d3-9504-4cbe-ae23-9acae8d74f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3c23cf20549d4b8bd3725f2e4d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:01Z,use_quota=True,user_id='91883e84234541cbb3ddb3fe230875f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31129dbd-8d7c-4ebe-acc1-fd248d92abf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31129dbd-8d7c-4ebe-acc1-fd248d92abf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0832ecee-f590-4f7c-b75d-0fcb686ea8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0832ecee-f590-4f7c-b75d-0fcb686ea8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a830a2d3-9504-4cbe-ae23-9acae8d74f24', 'volume_name': 'volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0a928a-494d-416a-965a-250210ac9806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0a928a-494d-416a-965a-250210ac9806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb59098-a874-43e8-980b-45fc5f384bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Volume a830a2d3-9504-4cbe-ae23-9acae8d74f24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24', 'volume_size': 1} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-955007864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a830a2d3-9504-4cbe-ae23-9acae8d74f24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fc3c23cf20549d4b8bd3725f2e4d63b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:01Z,use_quota=True,user_id='91883e84234541cbb3ddb3fe230875f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Creating volume a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:01 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:01 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 1073741824 Aug 03 08:53:01 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Flow 'volume_create_manager' (1adaa2a8-db84-41ff-9355-f190cc9d1d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f53167-ae45-4f75-b10f-57058ee1e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f53167-ae45-4f75-b10f-57058ee1e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1354882304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ba124-b823-47df-b828-fa32b529657f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ce3e454391403386a68fc80020aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:01Z,use_quota=True,user_id='4b3c75a80a464ce097a92615fcd1809c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb89d85a-20d5-480a-8d77-34546a848619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb89d85a-20d5-480a-8d77-34546a848619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b30a0b-7f2b-4982-9e2b-8a2365f01bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6b30a0b-7f2b-4982-9e2b-8a2365f01bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75ba124-b823-47df-b828-fa32b529657f', 'volume_name': 'volume-f75ba124-b823-47df-b828-fa32b529657f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba99534-dcba-4a3c-b228-0117adee6933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba99534-dcba-4a3c-b228-0117adee6933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a54047-70a8-41a9-a1dd-0c1999b72b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Volume f75ba124-b823-47df-b828-fa32b529657f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75ba124-b823-47df-b828-fa32b529657f', 'volume_size': 1} Aug 03 08:53:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:01 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 1073741824" returned: 0 in 0.737s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:02 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 Aug 03 08:53:02 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:02 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24" returned: 0 in 0.305s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1354882304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75ba124-b823-47df-b828-fa32b529657f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ce3e454391403386a68fc80020aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:01Z,use_quota=True,user_id='4b3c75a80a464ce097a92615fcd1809c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Creating volume f75ba124-b823-47df-b828-fa32b529657f {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:02 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfb59098-a874-43e8-980b-45fc5f384bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:02 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f 1073741824 Aug 03 08:53:02 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be8ae0-c62d-4ff5-87e9-3e3af5ea0871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:02 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Volume volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 (a830a2d3-9504-4cbe-ae23-9acae8d74f24): created successfully Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21be8ae0-c62d-4ff5-87e9-3e3af5ea0871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Flow 'volume_create_manager' (f909d304-1a09-4fbf-b420-9893af431239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-871e33fd-118d-480d-99e8-1bc1cb64a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Created volume successfully. Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:03 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f 1073741824" returned: 0 in 0.656s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:03 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f Aug 03 08:53:03 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:03 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.355s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a54047-70a8-41a9-a1dd-0c1999b72b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75ba124-b823-47df-b828-fa32b529657f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb1c51a-50aa-49af-9e6a-2623e4a1c664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Creating offline snapshot 1300f0ae-5786-4e18-9ffc-4f833681fcc6 of volume a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:53:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Volume volume-f75ba124-b823-47df-b828-fa32b529657f (f75ba124-b823-47df-b828-fa32b529657f): created successfully Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb1c51a-50aa-49af-9e6a-2623e4a1c664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Flow 'volume_create_manager' (1adaa2a8-db84-41ff-9355-f190cc9d1d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c652ab4c-e76c-424f-bef1-e9d532d3a328]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4a7c3e82-bae3-4557-924f-f9b1f8ad7f41 tempest-VolumesTransfersV355Test-1646118784 None] Created volume successfully. Aug 03 08:53:03 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 Aug 03 08:53:03 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:03 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24" returned: 0 in 0.421s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:03 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 1G Aug 03 08:53:03 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:04 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 1G" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:04 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 Aug 03 08:53:04 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:04 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:04 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 is being set with open permissions: ugo+rw Aug 03 08:53:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:04 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 Aug 03 08:53:04 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:05 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:05 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info Aug 03 08:53:05 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:05 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info" returned: 0 in 0.333s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:05 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info is being set with open permissions: ugo+rw Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:05 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info Aug 03 08:53:05 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1dcf18d3-7a8a-4bab-bc00-5831ab1c903e tempest-VolumesTransfersV355Test-1052252507 None] Transfer volume completed successfully. Aug 03 08:53:05 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.info" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.452s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1c4b3cbe-b77c-4ea6-88da-e167f6874a59 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Create snapshot completed successfully Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "cinder-f75ba124-b823-47df-b828-fa32b529657f-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-f75ba124-b823-47df-b828-fa32b529657f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "cinder-quobyte-f75ba124-b823-47df-b828-fa32b529657f" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-quobyte-f75ba124-b823-47df-b828-fa32b529657f" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3efbe28-7825-4de9-ac89-56d33a3326c1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:06 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f Aug 03 08:53:06 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "cinder-1300f0ae-5786-4e18-9ffc-4f833681fcc6-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-1300f0ae-5786-4e18-9ffc-4f833681fcc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "cinder-quobyte-1300f0ae-5786-4e18-9ffc-4f833681fcc6" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:06 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f" returned: 0 in 0.510s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-1300f0ae-5786-4e18-9ffc-4f833681fcc6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Deleting offline snapshot 1300f0ae-5786-4e18-9ffc-4f833681fcc6 of volume a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:06 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f Aug 03 08:53:06 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] snapshot_file for this snap is: volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10f3c83-8469-40b2-a687-81648810b490]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:07 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 Aug 03 08:53:07 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:07 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f75ba124-b823-47df-b828-fa32b529657f" returned: 0 in 0.289s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-quobyte-f75ba124-b823-47df-b828-fa32b529657f" released by "delete_volume" :: held 0.871s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Created reservations ['65cb44ff-a9a4-4a36-be90-76c9dc578e6d', '09903bb3-d5af-417b-a834-65ae23c9a7ff', 'cf1aeff4-a7d7-4845-99b7-7e5da4cb7ae9', '386f4b7e-6c1e-4df0-ab62-8d5742faa4d1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:07 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:07 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:07 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c82f813-4cf7-4cc6-9ad4-a4d5956d64bc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:07 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 Aug 03 08:53:07 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:07 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Deleted volume successfully. Aug 03 08:53:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-87d253ba-73e0-46d7-b724-47021a187144 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-f75ba124-b823-47df-b828-fa32b529657f-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:08 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24" returned: 0 in 0.557s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 Aug 03 08:53:08 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Flow 'volume_create_manager' (289cf7b2-4945-4e8e-8cec-95919250ab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543120-2881-43d8-b206-bfb8a4a0c98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52543120-2881-43d8-b206-bfb8a4a0c98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1101689261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84586c22-e84c-4e52-b524-55b20c3eefa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ce3e454391403386a68fc80020aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:08Z,use_quota=True,user_id='4b3c75a80a464ce097a92615fcd1809c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb1bb52-75b3-4e12-92f1-f737545b7659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb1bb52-75b3-4e12-92f1-f737545b7659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e88c73-eda1-4816-ab9a-b907850f4004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e88c73-eda1-4816-ab9a-b907850f4004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84586c22-e84c-4e52-b524-55b20c3eefa2', 'volume_name': 'volume-84586c22-e84c-4e52-b524-55b20c3eefa2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb58b4-18fd-4acf-ae26-2eb05431a52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccfb58b4-18fd-4acf-ae26-2eb05431a52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd9f540-2560-4afa-a6e3-473ade7dea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:08 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Volume 84586c22-e84c-4e52-b524-55b20c3eefa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84586c22-e84c-4e52-b524-55b20c3eefa2', 'volume_size': 1} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1101689261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84586c22-e84c-4e52-b524-55b20c3eefa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ce3e454391403386a68fc80020aaec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:08Z,use_quota=True,user_id='4b3c75a80a464ce097a92615fcd1809c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Creating volume 84586c22-e84c-4e52-b524-55b20c3eefa2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:08 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 1073741824 Aug 03 08:53:08 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6 Aug 03 08:53:08 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24.1300f0ae-5786-4e18-9ffc-4f833681fcc6" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:08 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:08 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-1300f0ae-5786-4e18-9ffc-4f833681fcc6" released by "_delete_snapshot" :: held 1.867s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" released by "delete_snapshot" :: held 1.918s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Created reservations ['e00cf06b-ad1c-4d05-acdf-c1d2c82de5ee', '9e59ba10-deb8-477a-9fc1-dabaca1e8935', '51b8d8ae-fac5-4ede-917f-4546563a7fcb', '923363bf-338f-4751-8bf7-d6e86461ccf8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:08 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 1073741824" returned: 0 in 0.576s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 Aug 03 08:53:09 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Delete snapshot completed successfully. Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1318064a-894a-4a5e-bfa0-dd480177e7e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-1300f0ae-5786-4e18-9ffc-4f833681fcc6-delete_snapshot" released by "delete_snapshot" :: held 2.215s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "cinder-a830a2d3-9504-4cbe-ae23-9acae8d74f24-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-a830a2d3-9504-4cbe-ae23-9acae8d74f24-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:09 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd9f540-2560-4afa-a6e3-473ade7dea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84586c22-e84c-4e52-b524-55b20c3eefa2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b076884-b84a-4abb-8e41-b8d08258091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8590a3f7-5616-461a-b285-47a94f67d7cf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Volume volume-84586c22-e84c-4e52-b524-55b20c3eefa2 (84586c22-e84c-4e52-b524-55b20c3eefa2): created successfully Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b076884-b84a-4abb-8e41-b8d08258091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Flow 'volume_create_manager' (289cf7b2-4945-4e8e-8cec-95919250ab34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5e662e73-444f-4533-aa27-dadf6f1fbf84 tempest-VolumesTransfersV355Test-1646118784 None] Created volume successfully. Aug 03 08:53:09 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 Aug 03 08:53:09 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:09 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:09 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24 Aug 03 08:53:09 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a830a2d3-9504-4cbe-ae23-9acae8d74f24" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-quobyte-a830a2d3-9504-4cbe-ae23-9acae8d74f24" released by "delete_volume" :: held 0.761s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Created reservations ['f6c6df35-631d-492c-a0f6-d96d98306a5d', '212c3cfe-913a-48a9-8f47-c075dd69f0c2', '210093d2-a949-4a1d-bc23-086e49edca16', 'b69bb6bc-6772-4bfb-9958-9a4e6144eed1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:10 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:10 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.336s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Deleted volume successfully. Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c1c519c-3621-4b39-b12a-4f4fca66157c tempest-VolumeSnapshotQuotasNegativeTestJSON-1970441937 None] Lock "cinder-a830a2d3-9504-4cbe-ae23-9acae8d74f24-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "cinder-84586c22-e84c-4e52-b524-55b20c3eefa2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-84586c22-e84c-4e52-b524-55b20c3eefa2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "cinder-quobyte-84586c22-e84c-4e52-b524-55b20c3eefa2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-quobyte-84586c22-e84c-4e52-b524-55b20c3eefa2" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40374b-083f-4935-8869-cb18dab50fbf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:10 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 Aug 03 08:53:10 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2" returned: 0 in 0.507s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2 Aug 03 08:53:11 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:11 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-84586c22-e84c-4e52-b524-55b20c3eefa2" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-quobyte-84586c22-e84c-4e52-b524-55b20c3eefa2" released by "delete_volume" :: held 0.867s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Created reservations ['5c6ef644-de3b-4c88-8830-5b04885da852', '494ecd03-9f55-46dd-ba5e-323271fffafc', '74c1aa60-c21a-4d2d-bf4f-deef8bf66c6b', '55a6faa5-5aa9-4d06-add9-7c5b9d123e59'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:11 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:11 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:12 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:12 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Deleted volume successfully. Aug 03 08:53:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-783c5907-932d-476b-96a7-b86c85a5efa5 tempest-VolumesTransfersV355Test-159710364 None] Lock "cinder-84586c22-e84c-4e52-b524-55b20c3eefa2-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10fc88b3-50ba-4851-a654-71ba198b6ae1 req-2e98c988-b7c0-4896-b984-2f2414c62f90 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10fc88b3-50ba-4851-a654-71ba198b6ae1 req-2e98c988-b7c0-4896-b984-2f2414c62f90 tempest-TestStampPattern-1987295736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10fc88b3-50ba-4851-a654-71ba198b6ae1 req-2e98c988-b7c0-4896-b984-2f2414c62f90 tempest-TestStampPattern-1987295736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-10fc88b3-50ba-4851-a654-71ba198b6ae1 req-2e98c988-b7c0-4896-b984-2f2414c62f90 tempest-TestStampPattern-1987295736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6466a0c1-4c15-495e-beb4-5c675f7368f8', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:53:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-10fc88b3-50ba-4851-a654-71ba198b6ae1 req-2e98c988-b7c0-4896-b984-2f2414c62f90 tempest-TestStampPattern-1987295736 None] attachment_update completed successfully. Aug 03 08:53:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f77dbad7-d144-4c68-aa2a-8b2af46a127f req-4abc7c4d-9e5f-48b9-89be-b7c740e4fec4 tempest-TestStampPattern-1987295736 None] Terminate volume connection completed successfully. Aug 03 08:53:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f77dbad7-d144-4c68-aa2a-8b2af46a127f req-4abc7c4d-9e5f-48b9-89be-b7c740e4fec4 tempest-TestStampPattern-1987295736 None] Deleting attachment 6466a0c1-4c15-495e-beb4-5c675f7368f8. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:53:31 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=36,cinder:UPDATE=41,cinder:DELETE=5,cinder:INSERT=11 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:53:36 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=40,cinder:UPDATE=42,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:53:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-a7dc4981-8239-4fba-9b0e-92c1dde39adc-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "cinder-a7dc4981-8239-4fba-9b0e-92c1dde39adc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d900e-58fb-4133-a6a4-da5b25176980]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc Aug 03 08:53:38 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc Aug 03 08:53:38 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:38 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a7dc4981-8239-4fba-9b0e-92c1dde39adc" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-a7dc4981-8239-4fba-9b0e-92c1dde39adc" released by "delete_volume" :: held 0.766s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Created reservations ['b79e3fa1-67a4-4491-97ff-992d16b12613', 'cbdb827b-e902-458e-be9d-af54d1642051', '6835dcb6-3b36-418b-bb9d-4ba0107e5f89', '1337f812-4c32-49df-b4c1-669a34b96f45'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:38 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:38 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:39 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.381s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Deleted volume successfully. Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-440cdd73-afeb-47b0-bd53-de37b8e4a509 tempest-TestStampPattern-1987295736 None] Lock "cinder-a7dc4981-8239-4fba-9b0e-92c1dde39adc-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Deleting offline snapshot ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 of volume 01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] snapshot_file for this snap is: volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fca324-884e-4e0b-9562-789ede28a9f2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:39 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:53:39 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01c07eac-f790-42cd-9cce-f7eec123a1d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3579f4a-4e02-4764-976f-cec1651bc940]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:53:40 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:40 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.731s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:40 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:53:40 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:41 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2 Aug 03 08:53:41 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:41 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1.ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" returned: 0 in 0.293s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2" released by "_delete_snapshot" :: held 2.072s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" released by "delete_snapshot" :: held 2.111s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Created reservations ['92ba81e8-b605-424d-a283-80214a9238c9', '5747870b-d899-41f5-9df0-1ddc5160d672', '891d358a-2cb2-41b9-962e-8e217f99e09b', '0d45e808-08f3-4fe4-9647-7e9ea94bff1e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Delete snapshot completed successfully. Aug 03 08:53:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-50dc31bb-39b1-4b6e-adaa-a241e117ae35 tempest-TestStampPattern-1987295736 None] Lock "cinder-ac9d46f5-2ba7-4a9f-aa6a-32dd38652ac2-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Flow 'volume_create_manager' (2135ae36-850d-4983-a486-649eafd3762c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6861d83-db88-4d93-9379-6305275aeacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6861d83-db88-4d93-9379-6305275aeacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64573673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232cfa84-a406-48be-829f-6f8763acc2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a5386937864f64bec3fb6f286b1795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:44Z,use_quota=True,user_id='ec484eac3eae4c08931b9b435331bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93afcec-c808-4a1d-9e07-b7041d41d4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93afcec-c808-4a1d-9e07-b7041d41d4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88683b6-0116-4d71-9b21-a00a96f6b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88683b6-0116-4d71-9b21-a00a96f6b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232cfa84-a406-48be-829f-6f8763acc2bf', 'volume_name': 'volume-232cfa84-a406-48be-829f-6f8763acc2bf', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0ba8f-e1a8-4745-a3b2-96ddbc9e4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d0ba8f-e1a8-4745-a3b2-96ddbc9e4600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9e76d-93a5-4e41-a7bb-09561e685262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Volume 232cfa84-a406-48be-829f-6f8763acc2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232cfa84-a406-48be-829f-6f8763acc2bf', 'volume_size': 1} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-64573673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232cfa84-a406-48be-829f-6f8763acc2bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a5386937864f64bec3fb6f286b1795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:44Z,use_quota=True,user_id='ec484eac3eae4c08931b9b435331bec7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Creating volume 232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:53:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:43 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf 1073741824 Aug 03 08:53:43 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:44 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf 1073741824" returned: 0 in 0.801s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:44 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:53:44 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:45 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.466s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc9e76d-93a5-4e41-a7bb-09561e685262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232cfa84-a406-48be-829f-6f8763acc2bf', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168ec79-b823-408b-990c-b1a0a70b00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Volume volume-232cfa84-a406-48be-829f-6f8763acc2bf (232cfa84-a406-48be-829f-6f8763acc2bf): created successfully Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a168ec79-b823-408b-990c-b1a0a70b00b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Flow 'volume_create_manager' (2135ae36-850d-4983-a486-649eafd3762c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-75bcffda-e73d-4586-80eb-b0521c7a05e5 tempest-VolumesActionsTest-1022888637 None] Created volume successfully. Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (0fba8f12-ea5f-4d38-9a99-2ae9b1822337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec6eb2-67da-457b-8cd4-ac252e5e7721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcec6eb2-67da-457b-8cd4-ac252e5e7721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259972111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdfe35a-af83-4de3-9c38-a13b1f89b930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:48Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a401bff-9619-426d-81e1-a27312beff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a401bff-9619-426d-81e1-a27312beff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67768814-cdff-4a4c-bd63-b8ddfaf497b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67768814-cdff-4a4c-bd63-b8ddfaf497b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbdfe35a-af83-4de3-9c38-a13b1f89b930', 'volume_name': 'volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa4de0d-c32e-4a9c-82ad-26981d86a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa4de0d-c32e-4a9c-82ad-26981d86a22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961a5b5d-d4c3-46d8-9f13-b35fc8e0dc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Volume cbdfe35a-af83-4de3-9c38-a13b1f89b930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930', 'volume_size': 1} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259972111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbdfe35a-af83-4de3-9c38-a13b1f89b930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:53:48Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Creating volume cbdfe35a-af83-4de3-9c38-a13b1f89b930 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:53:48 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:53:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:48 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 1073741824 Aug 03 08:53:48 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 1073741824" returned: 0 in 0.687s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 Aug 03 08:53:49 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-01c07eac-f790-42cd-9cce-f7eec123a1d1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "cinder-01c07eac-f790-42cd-9cce-f7eec123a1d1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Acquiring lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3ccf8-46dd-4a53-801b-fd648d240827]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:49 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:53:49 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:49 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930" returned: 0 in 0.440s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961a5b5d-d4c3-46d8-9f13-b35fc8e0dc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6ba70-6539-443d-a2b9-8cedc9b47a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:53:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Volume volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 (cbdfe35a-af83-4de3-9c38-a13b1f89b930): created successfully Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b6ba70-6539-443d-a2b9-8cedc9b47a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:53:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (0fba8f12-ea5f-4d38-9a99-2ae9b1822337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:53:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4bdd8b16-0a81-4d8d-9fc6-ac7743addf49 tempest-AttachVolumeNegativeTest-919177382 None] Created volume successfully. Aug 03 08:53:50 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.547s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1 Aug 03 08:53:50 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:50 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01c07eac-f790-42cd-9cce-f7eec123a1d1" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "cinder-quobyte-01c07eac-f790-42cd-9cce-f7eec123a1d1" released by "delete_volume" :: held 0.998s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Created reservations ['42615b63-d4eb-40b8-a980-4ff1efc77aca', '9cebb2e1-c275-41e0-bf41-46706398706f', '88a525cb-6330-453c-91b7-17ab99bc3813', '1b6959ea-3c8c-4f70-9877-80b1b659e6b4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:53:50 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:53:50 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:53:51 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.441s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:53:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Deleted volume successfully. Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2663f741-1f70-4e02-ab8f-8e63b015476d tempest-TestStampPattern-1987295736 None] Lock "cinder-01c07eac-f790-42cd-9cce-f7eec123a1d1-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-bce08638-6dd5-428a-8844-caf8200ebcc3 req-a0a39209-a412-4e8b-8048-9474a7b2b829 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-bce08638-6dd5-428a-8844-caf8200ebcc3 req-a0a39209-a412-4e8b-8048-9474a7b2b829 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:53:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-bce08638-6dd5-428a-8844-caf8200ebcc3 req-a0a39209-a412-4e8b-8048-9474a7b2b829 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:53:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-bce08638-6dd5-428a-8844-caf8200ebcc3 req-a0a39209-a412-4e8b-8048-9474a7b2b829 tempest-AttachVolumeNegativeTest-919177382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3670e44f-b91e-4605-8984-b7bed98e45fd', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:53:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-bce08638-6dd5-428a-8844-caf8200ebcc3 req-a0a39209-a412-4e8b-8048-9474a7b2b829 tempest-AttachVolumeNegativeTest-919177382 None] attachment_update completed successfully. Aug 03 08:54:02 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=26,cinder:SELECT=25,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:54:02 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=27,cinder:INSERT=7,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-24fc1a27-5d08-4bf5-8cd8-2d4f6030137a tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" by "attach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-24fc1a27-5d08-4bf5-8cd8-2d4f6030137a tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" acquired by "attach_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-24fc1a27-5d08-4bf5-8cd8-2d4f6030137a tempest-VolumesActionsTest-1022888637 None] Attaching volume 232cfa84-a406-48be-829f-6f8763acc2bf to instance c52776cd-132b-4af6-a3df-0cb2a3bba225 at mountpoint /dev/vdb on host None. Aug 03 08:54:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-24fc1a27-5d08-4bf5-8cd8-2d4f6030137a tempest-VolumesActionsTest-1022888637 None] Attach volume completed successfully. Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-24fc1a27-5d08-4bf5-8cd8-2d4f6030137a tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" released by "attach_volume" :: held 0.219s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9bb1086c-950d-41fe-851d-534b8227cf4f tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" by "detach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9bb1086c-950d-41fe-851d-534b8227cf4f tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9bb1086c-950d-41fe-851d-534b8227cf4f tempest-VolumesActionsTest-1022888637 None] Detaching volume 232cfa84-a406-48be-829f-6f8763acc2bf from instance c52776cd-132b-4af6-a3df-0cb2a3bba225. Aug 03 08:54:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9bb1086c-950d-41fe-851d-534b8227cf4f tempest-VolumesActionsTest-1022888637 None] Detach volume completed successfully. Aug 03 08:54:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9bb1086c-950d-41fe-851d-534b8227cf4f tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" released by "detach_volume" :: held 0.165s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:08 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:54:08 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (7b1625d6-def8-4c55-a97c-9066a96603a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab90cdd-4732-4f72-b23b-66cf89a500c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ab90cdd-4732-4f72-b23b-66cf89a500c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894291780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94b0d3d-9b8d-420f-9776-05cf633e5bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:09Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e379570-31aa-49eb-99ab-626f12b848f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e379570-31aa-49eb-99ab-626f12b848f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7590c8b1-9266-441c-b741-f9bfc8d3afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7590c8b1-9266-441c-b741-f9bfc8d3afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94b0d3d-9b8d-420f-9776-05cf633e5bd9', 'volume_name': 'volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd299dc-d089-43f2-878d-8c44fcf1265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acd299dc-d089-43f2-878d-8c44fcf1265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51037a37-1969-48c4-bef8-054ab11588c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Volume e94b0d3d-9b8d-420f-9776-05cf633e5bd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9', 'volume_size': 1} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1894291780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94b0d3d-9b8d-420f-9776-05cf633e5bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:09Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Creating volume e94b0d3d-9b8d-420f-9776-05cf633e5bd9 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:09 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.970s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:54:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:54:09 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 1073741824 Aug 03 08:54:09 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:10 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 1073741824" returned: 0 in 1.016s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:10 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 Aug 03 08:54:10 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:11 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" returned: 0 in 0.720s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51037a37-1969-48c4-bef8-054ab11588c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7233c1-07e6-4287-9d52-67f4092b719f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Volume volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 (e94b0d3d-9b8d-420f-9776-05cf633e5bd9): created successfully Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c7233c1-07e6-4287-9d52-67f4092b719f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (7b1625d6-def8-4c55-a97c-9066a96603a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-31f1304f-016e-4dae-8bde-0be9ca39fe25 tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:54:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e8fd95b-6fd0-4143-8bae-823dfaed73aa tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" by "attach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e8fd95b-6fd0-4143-8bae-823dfaed73aa tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" acquired by "attach_volume" :: waited 0.046s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2e8fd95b-6fd0-4143-8bae-823dfaed73aa tempest-VolumesActionsTest-388507239 None] Attaching volume e94b0d3d-9b8d-420f-9776-05cf633e5bd9 to instance 44677366-30f4-450b-87b4-ffddadd8302c at mountpoint /dev/vdb on host None. Aug 03 08:54:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2e8fd95b-6fd0-4143-8bae-823dfaed73aa tempest-VolumesActionsTest-388507239 None] Attach volume completed successfully. Aug 03 08:54:13 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e8fd95b-6fd0-4143-8bae-823dfaed73aa tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" released by "attach_volume" :: held 0.320s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Terminate volume connection completed successfully. Aug 03 08:54:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" by "detach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Detaching volume e94b0d3d-9b8d-420f-9776-05cf633e5bd9 from instance 44677366-30f4-450b-87b4-ffddadd8302c. Aug 03 08:54:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Detach volume completed successfully. Aug 03 08:54:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-47646e71-4a0e-4df3-8786-8cac116502b5 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" released by "detach_volume" :: held 0.204s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-78f3ca32-4a97-44b5-a833-a84e6b9f17d9 tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" by "detach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-78f3ca32-4a97-44b5-a833-a84e6b9f17d9 tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-78f3ca32-4a97-44b5-a833-a84e6b9f17d9 tempest-VolumesActionsTest-388507239 None] Volume detach called, but volume not attached. Aug 03 08:54:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-78f3ca32-4a97-44b5-a833-a84e6b9f17d9 tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-quobyte-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "cinder-quobyte-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" acquired by "delete_volume" :: waited 0.067s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dd34a2-971f-4e83-997d-988ada82bbd9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:16 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 Aug 03 08:54:16 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:17 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" returned: 0 in 1.215s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:17 devstack sudo[99585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9 Aug 03 08:54:17 devstack sudo[99585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:18 devstack sudo[99585]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" returned: 0 in 0.869s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "cinder-quobyte-e94b0d3d-9b8d-420f-9776-05cf633e5bd9" released by "delete_volume" :: held 2.279s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:18 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Created reservations ['a08d7d53-fa67-4bf4-b863-518f07871b1a', '32ea9f30-05e1-4eae-aaba-095eedaaf7ee', '839f2a7d-32dc-4c69-8f99-d92316c01607', 'f3799353-cf8e-484d-9834-0422df3f92c3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:19 devstack sudo[99615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:54:19 devstack sudo[99615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:19 devstack sudo[99615]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.544s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Deleted volume successfully. Aug 03 08:54:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b0287efb-219c-4d60-88b1-38217945c5cd tempest-VolumesActionsTest-388507239 None] Lock "cinder-e94b0d3d-9b8d-420f-9776-05cf633e5bd9-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Flow 'volume_create_manager' (abaf4b25-2dc2-40b9-af33-f348868cb5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb41542-1a05-4ff7-82b3-402c6416f50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb41542-1a05-4ff7-82b3-402c6416f50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45537865-028f-4fbb-9e4a-6f3b3776d48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb27068c03dc4ebd9eee17c890d88887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:25Z,use_quota=True,user_id='366b0df75b4c4965be89915ca3c9c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4134cb9-0b76-401e-96ca-51e2f2152e28),volume_type_id=e4134cb9-0b76-401e-96ca-51e2f2152e28)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2de399-ecd6-4bea-a252-20fd0debbdf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2de399-ecd6-4bea-a252-20fd0debbdf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18001e0-5d98-4d74-9b14-41b0c885fbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:25 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c18001e0-5d98-4d74-9b14-41b0c885fbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45537865-028f-4fbb-9e4a-6f3b3776d48b', 'volume_name': 'volume-45537865-028f-4fbb-9e4a-6f3b3776d48b', 'volume_size': 1, 'image_id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd2766c1363f2f037fc402a9ee051e87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb27068c03dc4ebd9eee17c890d88887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d20c4ccd0d3d6ea4245a79d8ba9111f108ee402e4dac2782571dd4e19186e8e0958e695c251f46e149bfe81a12eaeac9db2ee5e534a240d5f58f29a81cac359', 'id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6321dee-285d-4d46-a8b1-8fca738f14fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6321dee-285d-4d46-a8b1-8fca738f14fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1885822-3938-4abd-87f1-ccad82c1b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Volume 45537865-028f-4fbb-9e4a-6f3b3776d48b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45537865-028f-4fbb-9e4a-6f3b3776d48b', 'volume_size': 1, 'image_id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd2766c1363f2f037fc402a9ee051e87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb27068c03dc4ebd9eee17c890d88887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d20c4ccd0d3d6ea4245a79d8ba9111f108ee402e4dac2782571dd4e19186e8e0958e695c251f46e149bfe81a12eaeac9db2ee5e534a240d5f58f29a81cac359', 'id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Trying to clone 45537865-028f-4fbb-9e4a-6f3b3776d48b from image c5b44c22-30b5-4879-9f2b-0f28fe71014f at location (None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:54:26 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:54:26 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Image download 0.00 MB at 0.00 MB/s Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4565d0b-1fa4-4193-a4d2-dedfba33f780]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:27 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (0fa2ab38-7f7f-421f-b04d-92da749ee644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11667357-d096-4699-b59b-8c351b04c2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11667357-d096-4699-b59b-8c351b04c2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2109022156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e766d8f9-6943-4ab7-869d-70796a70a464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:27Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bf9b5f-f442-4a0c-947b-234be0bc9330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63bf9b5f-f442-4a0c-947b-234be0bc9330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8f9f52-86e1-42ce-9466-8f8efe063bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8f9f52-86e1-42ce-9466-8f8efe063bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e766d8f9-6943-4ab7-869d-70796a70a464', 'volume_name': 'volume-e766d8f9-6943-4ab7-869d-70796a70a464', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7cad54-94f9-49cd-87a6-c8956b042c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc7cad54-94f9-49cd-87a6-c8956b042c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2f3904-7f05-4bd0-a14c-ab9a0599aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Volume e766d8f9-6943-4ab7-869d-70796a70a464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e766d8f9-6943-4ab7-869d-70796a70a464', 'volume_size': 1} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2109022156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e766d8f9-6943-4ab7-869d-70796a70a464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:27Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Creating volume e766d8f9-6943-4ab7-869d-70796a70a464 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 1073741824 Aug 03 08:54:27 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:27 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:27 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:27 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 1 in 0.638s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Temporary image c5b44c22-30b5-4879-9f2b-0f28fe71014f is fetched for user 366b0df75b4c4965be89915ca3c9c5b1. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e77787-4e57-49db-bf7e-0b6e62068513]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 1073741824" returned: 0 in 1.003s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:28 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:28 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 Aug 03 08:54:28 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:28 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2f3904-7f05-4bd0-a14c-ab9a0599aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e766d8f9-6943-4ab7-869d-70796a70a464', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ccdc2-756c-43d3-8c1f-a7446469aae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Volume volume-e766d8f9-6943-4ab7-869d-70796a70a464 (e766d8f9-6943-4ab7-869d-70796a70a464): created successfully Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ccdc2-756c-43d3-8c1f-a7446469aae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (0fa2ab38-7f7f-421f-b04d-92da749ee644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bff67f8d-6de0-4f72-adfa-a55ead2fd2f1 tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:54:29 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:29 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 1 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45537865-028f-4fbb-9e4a-6f3b3776d48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb27068c03dc4ebd9eee17c890d88887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:25Z,use_quota=True,user_id='366b0df75b4c4965be89915ca3c9c5b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4134cb9-0b76-401e-96ca-51e2f2152e28),volume_type_id=e4134cb9-0b76-401e-96ca-51e2f2152e28)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Creating volume 45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:29 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1073741824 Aug 03 08:54:29 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-e766d8f9-6943-4ab7-869d-70796a70a464-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-e766d8f9-6943-4ab7-869d-70796a70a464-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-quobyte-e766d8f9-6943-4ab7-869d-70796a70a464" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-e766d8f9-6943-4ab7-869d-70796a70a464" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21b784a-4a19-4919-99e5-83367a1435d4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bb3c283-7d82-4c05-896f-069f5b076c89 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" by "attach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bb3c283-7d82-4c05-896f-069f5b076c89 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" acquired by "attach_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 Aug 03 08:54:30 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5bb3c283-7d82-4c05-896f-069f5b076c89 tempest-VolumesActionsTest-1022888637 None] Attaching volume 232cfa84-a406-48be-829f-6f8763acc2bf to instance 8c886a16-dab5-4d88-8e38-15ea607fa3a6 at mountpoint /dev/vdb on host None. Aug 03 08:54:30 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1073741824" returned: 0 in 0.867s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5bb3c283-7d82-4c05-896f-069f5b076c89 tempest-VolumesActionsTest-1022888637 None] Attach volume completed successfully. Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bb3c283-7d82-4c05-896f-069f5b076c89 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf" released by "attach_volume" :: held 0.235s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:30 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b Aug 03 08:54:30 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:30 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Attempting download of c5b44c22-30b5-4879-9f2b-0f28fe71014f ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}])) to volume 45537865-028f-4fbb-9e4a-6f3b3776d48b. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:54:30 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464" returned: 0 in 0.761s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54ed1f4f-17e4-4341-9aeb-259bfbe39ea1 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" by "detach_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:30 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464 Aug 03 08:54:30 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d68442-306c-49a0-8b6a-b70752ddd227]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54ed1f4f-17e4-4341-9aeb-259bfbe39ea1 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" acquired by "detach_volume" :: waited 0.052s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-54ed1f4f-17e4-4341-9aeb-259bfbe39ea1 tempest-VolumesActionsTest-1022888637 None] Detaching volume 232cfa84-a406-48be-829f-6f8763acc2bf from instance 8c886a16-dab5-4d88-8e38-15ea607fa3a6. Aug 03 08:54:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-54ed1f4f-17e4-4341-9aeb-259bfbe39ea1 tempest-VolumesActionsTest-1022888637 None] Detach volume completed successfully. Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54ed1f4f-17e4-4341-9aeb-259bfbe39ea1 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:31 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo Aug 03 08:54:31 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e766d8f9-6943-4ab7-869d-70796a70a464" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-e766d8f9-6943-4ab7-869d-70796a70a464" released by "delete_volume" :: held 1.294s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:31 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo" returned: 0 in 0.471s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Created reservations ['82bc2fba-4fba-48e4-8f15-613dfc2c9474', '58d8279a-ec14-4dac-92ca-cc10148726cc', '284c60ce-d6f8-45c7-a75b-8efdd831e67d', 'fcd40a12-d975-453c-83af-31d720914aa7'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:31 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo Aug 03 08:54:31 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:54:31 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo" returned: 1 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c5b44c22-30b5-4879-9f2b-0f28fe71014f_eql1m8jo' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae469723-f23f-449d-96f3-2f24af920caa]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:31 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:31 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:31 devstack sudo[99834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:31 devstack sudo[99834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Deleted volume successfully. Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fd8baf3f-284f-4b7e-b401-0b65ff993a16 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-e766d8f9-6943-4ab7-869d-70796a70a464-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:32 devstack sudo[99834]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD Aug 03 08:54:32 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD" returned: 1 in 0.468s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] c5b44c22-30b5-4879-9f2b-0f28fe71014f was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:32 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b Aug 03 08:54:32 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (f09b41b4-1386-4efb-a0b8-8987e53d350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8432610a-83e7-4beb-b371-2eb86e8d020a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8432610a-83e7-4beb-b371-2eb86e8d020a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704572252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7df479-7075-41ee-beb7-cc243a06295e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:33Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f582f96-294a-4fb9-8c4f-6c33bad7c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f582f96-294a-4fb9-8c4f-6c33bad7c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd060fb-1c9a-44e1-89cf-4fb76ca614cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd060fb-1c9a-44e1-89cf-4fb76ca614cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7df479-7075-41ee-beb7-cc243a06295e', 'volume_name': 'volume-9b7df479-7075-41ee-beb7-cc243a06295e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d07f6c6-bc1d-4476-a9f0-b16716cb52f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d07f6c6-bc1d-4476-a9f0-b16716cb52f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dc8a2d-899e-4d6f-8058-44735688d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:33 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Volume 9b7df479-7075-41ee-beb7-cc243a06295e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7df479-7075-41ee-beb7-cc243a06295e', 'volume_size': 1} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-704572252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7df479-7075-41ee-beb7-cc243a06295e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:33Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Creating volume 9b7df479-7075-41ee-beb7-cc243a06295e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:54:33 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e 1073741824 Aug 03 08:54:33 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b" returned: 0 in 0.667s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c5b44c22-30b5-4879-9f2b-0f28fe71014f_agpr64hkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:33 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1G Aug 03 08:54:33 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e 1073741824" returned: 0 in 0.593s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:33 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e Aug 03 08:54:33 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:33 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b 1G" returned: 0 in 0.430s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Downloaded image c5b44c22-30b5-4879-9f2b-0f28fe71014f ((None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}])) to volume 45537865-028f-4fbb-9e4a-6f3b3776d48b successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Temporary image c5b44c22-30b5-4879-9f2b-0f28fe71014f for user 366b0df75b4c4965be89915ca3c9c5b1 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Marking volume 45537865-028f-4fbb-9e4a-6f3b3776d48b as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Copying metadata from image c5b44c22-30b5-4879-9f2b-0f28fe71014f to 45537865-028f-4fbb-9e4a-6f3b3776d48b. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:54:33 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Creating volume glance metadata for volume 45537865-028f-4fbb-9e4a-6f3b3776d48b backed by image c5b44c22-30b5-4879-9f2b-0f28fe71014f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd2766c1363f2f037fc402a9ee051e87', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1885822-3938-4abd-87f1-ccad82c1b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45537865-028f-4fbb-9e4a-6f3b3776d48b', 'volume_size': 1, 'image_id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd2766c1363f2f037fc402a9ee051e87', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fb27068c03dc4ebd9eee17c890d88887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d20c4ccd0d3d6ea4245a79d8ba9111f108ee402e4dac2782571dd4e19186e8e0958e695c251f46e149bfe81a12eaeac9db2ee5e534a240d5f58f29a81cac359', 'id': 'c5b44c22-30b5-4879-9f2b-0f28fe71014f', 'created_at': datetime.datetime(2026, 8, 3, 6, 54, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 54, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c5b44c22-30b5-4879-9f2b-0f28fe71014f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c55f9f6-fae4-4707-bac8-2fafd182dc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Volume volume-45537865-028f-4fbb-9e4a-6f3b3776d48b (45537865-028f-4fbb-9e4a-6f3b3776d48b): created successfully Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c55f9f6-fae4-4707-bac8-2fafd182dc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Flow 'volume_create_manager' (abaf4b25-2dc2-40b9-af33-f348868cb5db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a14a3bb9-05d0-4c93-9fb9-3bc485986542 tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Created volume successfully. Aug 03 08:54:34 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42dc8a2d-899e-4d6f-8058-44735688d103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7df479-7075-41ee-beb7-cc243a06295e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a572cc7-24f3-423c-9f92-63e2d7491d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Volume volume-9b7df479-7075-41ee-beb7-cc243a06295e (9b7df479-7075-41ee-beb7-cc243a06295e): created successfully Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a572cc7-24f3-423c-9f92-63e2d7491d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (f09b41b4-1386-4efb-a0b8-8987e53d350b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3d303127-5ac1-42bc-ae22-5c3542537796 tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Acquiring lock "cinder-45537865-028f-4fbb-9e4a-6f3b3776d48b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "cinder-45537865-028f-4fbb-9e4a-6f3b3776d48b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Acquiring lock "cinder-quobyte-45537865-028f-4fbb-9e4a-6f3b3776d48b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "cinder-quobyte-45537865-028f-4fbb-9e4a-6f3b3776d48b" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371716c-6b3e-45fb-8439-89522162109a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b Aug 03 08:54:35 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-9b7df479-7075-41ee-beb7-cc243a06295e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-9b7df479-7075-41ee-beb7-cc243a06295e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-quobyte-9b7df479-7075-41ee-beb7-cc243a06295e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-9b7df479-7075-41ee-beb7-cc243a06295e" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[67876d12-cc1e-4a25-acb8-ac00e45ec6d9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b" returned: 0 in 0.468s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e Aug 03 08:54:35 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b Aug 03 08:54:35 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-45537865-028f-4fbb-9e4a-6f3b3776d48b" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e" returned: 0 in 0.403s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "cinder-quobyte-45537865-028f-4fbb-9e4a-6f3b3776d48b" released by "delete_volume" :: held 0.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:35 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e Aug 03 08:54:35 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:35 devstack cinder-volume[88796]: WARNING cinder.quota [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:54:35 devstack cinder-volume[88796]: WARNING cinder.quota [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:54:35 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Created reservations ['33ae0354-3002-4e88-83d7-6043b283c62c', 'dc8e2a8b-52bf-4102-b55a-8731943f7ed6', '46a54078-077e-4745-a6f5-25a1b4aaa16b', '8f2b814f-b359-413d-8188-92029f8706e1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:54:36 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3243ed6c-5e11-4ebb-a9b0-e0469bab76b6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b7df479-7075-41ee-beb7-cc243a06295e" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-9b7df479-7075-41ee-beb7-cc243a06295e" released by "delete_volume" :: held 0.796s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:36 devstack sudo[99940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:54:36 devstack sudo[99940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Created reservations ['828ab961-3b50-4924-9d90-2e1f27bbc9e8', 'f6e4400d-14c1-4500-b6d2-56d4adff4711', '72355ebd-62f0-4006-b3f9-19eacf1f82f8', 'c1f1eb73-0475-4fe2-87cd-f6654f821649'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:54:36 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Deleted volume successfully. Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db383199-57dd-4425-bd3b-362df5c0debb tempest-VolumeAndVolumeTypeFromImageTest-20453202 None] Lock "cinder-45537865-028f-4fbb-9e4a-6f3b3776d48b-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:54:36 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[99940]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[49676d6d-4fc1-44dd-950b-d08020d72786]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:36 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:54:36 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:36 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:54:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Deleted volume successfully. Aug 03 08:54:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0c1295d-8489-4b94-80b2-294817745e81 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-9b7df479-7075-41ee-beb7-cc243a06295e-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:54:37 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.645s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.1f55d901-6768-4d39-8f0e-62b218bd3315l8mzi_3s.img {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:37 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.1f55d901-6768-4d39-8f0e-62b218bd3315l8mzi_3s.img Aug 03 08:54:37 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (137dd6a8-c37d-4475-88c4-4a919f7dedc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd80269-b300-4770-bf1e-bf227a8db65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd80269-b300-4770-bf1e-bf227a8db65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518906188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cf6aae-1c9f-4c1c-a345-f01235b2bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:37Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc830634-a985-4d74-b5db-5184ab872971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc830634-a985-4d74-b5db-5184ab872971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b208d0-7278-4a74-9434-e472ab85409d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b208d0-7278-4a74-9434-e472ab85409d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cf6aae-1c9f-4c1c-a345-f01235b2bba8', 'volume_name': 'volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29ffa57-ed66-4980-8c6d-29360d33c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e29ffa57-ed66-4980-8c6d-29360d33c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ee5cdc-a497-44b5-9f60-d3604c8b5790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:37 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Volume b7cf6aae-1c9f-4c1c-a345-f01235b2bba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8', 'volume_size': 1} Aug 03 08:54:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:42 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.1f55d901-6768-4d39-8f0e-62b218bd3315l8mzi_3s.img" returned: 0 in 5.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[737dfeef-9de8-456b-8dca-5ac4abb0033a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:54:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:54:42 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:54:42 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:54:43 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Aug 03 08:54:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.689s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:54:43 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.1f55d901-6768-4d39-8f0e-62b218bd3315l8mzi_3s.img {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:54:43 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Converted 1024.00 MB image at 194.15 MB/s Aug 03 08:54:43 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] 1f55d901-6768-4d39-8f0e-62b218bd3315 was raw, no need to convert to raw {{(pid=88796) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (8c70b6f7-63ec-45a7-8b2a-be070e36b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61a7e25-d49a-405b-b470-0c77702eeb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61a7e25-d49a-405b-b470-0c77702eeb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748040398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:45Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e696f-4d15-4416-9397-5f1eeb3ef410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003e696f-4d15-4416-9397-5f1eeb3ef410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfb0970-ade7-4efa-9fce-3f91734df17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfb0970-ade7-4efa-9fce-3f91734df17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3', 'volume_name': 'volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce48cc9e-7c09-4097-8d04-31172fc5fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce48cc9e-7c09-4097-8d04-31172fc5fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82825ff5-7706-4376-a5b4-57c22f0dc212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:54:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume 2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3', 'volume_size': 1} Aug 03 08:54:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:54:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f5f753a0-b946-4281-b7c0-b3004f4fea3b req-75e43b12-32b3-4e4b-b984-30edd68b5c83 tempest-AttachVolumeNegativeTest-919177382 None] Terminate volume connection completed successfully. Aug 03 08:54:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f5f753a0-b946-4281-b7c0-b3004f4fea3b req-75e43b12-32b3-4e4b-b984-30edd68b5c83 tempest-AttachVolumeNegativeTest-919177382 None] Deleting attachment 3670e44f-b91e-4605-8984-b7bed98e45fd. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:54:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:INSERT=18,cinder:SELECT=62,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:54:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=57,cinder:UPDATE=57,cinder:INSERT=18,cinder:DELETE=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.057s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Uploaded volume to glance image-id: 1f55d901-6768-4d39-8f0e-62b218bd3315. {{(pid=88796) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.571s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-518906188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cf6aae-1c9f-4c1c-a345-f01235b2bba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:37Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Creating volume b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:07 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:07 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 1073741824 Aug 03 08:55:07 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fe938693-13ad-4ab1-9116-e374c9cce35b tempest-VolumesActionsTest-1022888637 None] Copy volume to image completed successfully. Aug 03 08:55:07 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 1073741824" returned: 0 in 0.609s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:07 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 Aug 03 08:55:07 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.951s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748040398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:54:45Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume 2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:08 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31ee5cdc-a497-44b5-9f60-d3604c8b5790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df92ec35-5eb9-45d6-818a-e4b4081cdd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:08 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 1073741824 Aug 03 08:55:08 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Volume volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 (b7cf6aae-1c9f-4c1c-a345-f01235b2bba8): created successfully Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df92ec35-5eb9-45d6-818a-e4b4081cdd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (137dd6a8-c37d-4475-88c4-4a919f7dedc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9edaed05-60e3-48eb-8ec6-25fe1ff4bc54 tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:08 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:08 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 1073741824" returned: 0 in 0.576s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:08 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 Aug 03 08:55:08 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.305s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:09 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" returned: 0 in 0.306s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.050s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82825ff5-7706-4376-a5b4-57c22f0dc212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f084a7-8ee9-47ee-8ba8-37998d3ba63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6007c8-dac1-4149-83ad-5a3bed0ab202]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 (2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3): created successfully Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64f084a7-8ee9-47ee-8ba8-37998d3ba63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (8c70b6f7-63ec-45a7-8b2a-be070e36b252) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bcef2039-7387-4b4e-9700-ee6fb8e99417 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:09 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:55:09 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-quobyte-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d257e302-04a2-4571-a1ad-cec27a54b182]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5633734-a993-4f42-a01b-400ec006d590]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 Aug 03 08:55:09 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:55:09 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:09 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:09 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8 Aug 03 08:55:09 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:09 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:10 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img Aug 03 08:55:10 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:10 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8" released by "delete_volume" :: held 0.723s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Created reservations ['1e924a71-ea49-4b80-9689-f991117bd116', 'ca983dd1-ee02-4004-b4c3-1b1e9fed4461', '5a494246-6a37-4f0d-8657-af1036ec0a23', '1e35d7b0-6d5a-4718-93a3-8f49bfd5da94'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:10 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:10 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:11 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.966s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:11 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Deleted volume successfully. Aug 03 08:55:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-303dfc71-a1fb-4b8a-99b2-e5422b37e096 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-b7cf6aae-1c9f-4c1c-a345-f01235b2bba8-delete_volume" released by "delete_volume" :: held 2.123s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (5f6d415e-edd9-48f8-bdd2-c0e2766748b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2f41c0-2d59-418a-aef9-df9f0600ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2f41c0-2d59-418a-aef9-df9f0600ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443477288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2164d60-67eb-4a88-b6a7-e9ec18974034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:13Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26040972-00d3-4fc3-9d49-c21ad0c29b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26040972-00d3-4fc3-9d49-c21ad0c29b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd38ef0-07c8-4aac-903b-d0ddffc818e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd38ef0-07c8-4aac-903b-d0ddffc818e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2164d60-67eb-4a88-b6a7-e9ec18974034', 'volume_name': 'volume-d2164d60-67eb-4a88-b6a7-e9ec18974034', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1117695b-8a82-4697-b48d-9a696c90f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1117695b-8a82-4697-b48d-9a696c90f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b676fa-cc64-460e-bd1c-895c95a4dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Volume d2164d60-67eb-4a88-b6a7-e9ec18974034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2164d60-67eb-4a88-b6a7-e9ec18974034', 'volume_size': 1} Aug 03 08:55:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:15 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img" returned: 0 in 5.896s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3f846e-3cd3-4f4a-88fc-7a8c8c3b8c2b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:16 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:55:16 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:16 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.536s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf, size 1024.00 MB, duration 5.90 sec, destination /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:55:16 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Converted 1024.00 MB image at 173.61 MB/s Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] f332ac68-f3a0-48ac-999a-85928aaef5cc was raw, converting to qcow2 {{(pid=88796) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef7a31-0424-47f8-8777-3a5c59c26d4b]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:16 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img Aug 03 08:55:16 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:16 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:16 devstack sudo[100591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img Aug 03 08:55:16 devstack sudo[100591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:17 devstack sudo[100591]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img" returned: 1 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:17 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq Aug 03 08:55:17 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:17 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Image conversion details: src /opt/stack/data/cinder/conversion/232cfa84-a406-48be-829f-6f8763acc2bf.temp_image.f332ac68-f3a0-48ac-999a-85928aaef5ccups47f8h.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:55:17 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fa920d-e848-4509-99be-1dac56241648]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:17 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq Aug 03 08:55:17 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:17 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_u8chcgdq" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.977s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Uploaded volume to glance image-id: f332ac68-f3a0-48ac-999a-85928aaef5cc. {{(pid=88796) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.077s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating offline snapshot 46053413-8201-4fd1-988c-1e02b2d4bce7 of volume 2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-619b95b0-77f7-48a9-a99c-d7a6f9ebbf8d tempest-VolumesActionsTest-1022888637 None] Copy volume to image completed successfully. Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7c6f0a-dc84-4c29-9756-58fd319f118b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:19 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 Aug 03 08:55:19 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:19 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:19 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 1G Aug 03 08:55:19 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 1G" returned: 0 in 0.475s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 Aug 03 08:55:20 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7" returned: 0 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 is being set with open permissions: ugo+rw Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 Aug 03 08:55:20 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "cinder-quobyte-232cfa84-a406-48be-829f-6f8763acc2bf" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-quobyte-232cfa84-a406-48be-829f-6f8763acc2bf" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e65708-0325-41bb-82db-3c05c6af625e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:55:20 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info Aug 03 08:55:20 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:20 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:20 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf Aug 03 08:55:20 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:21 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info is being set with open permissions: ugo+rw Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:21 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info Aug 03 08:55:21 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:21 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-232cfa84-a406-48be-829f-6f8763acc2bf" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:21 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.info" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-quobyte-232cfa84-a406-48be-829f-6f8763acc2bf" released by "delete_volume" :: held 0.761s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.443s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-443477288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2164d60-67eb-4a88-b6a7-e9ec18974034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:13Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Creating volume d2164d60-67eb-4a88-b6a7-e9ec18974034 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:21 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 1073741824 Aug 03 08:55:21 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e691fe77-0440-402d-a02b-31d662dd2cf4 tempest-CreateVolumesFromSnapshotTest-637795860 None] Create snapshot completed successfully Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Created reservations ['4afe8f3a-0f76-4033-8597-d45ae2e2bc54', '16c57020-4784-4c0b-b204-61ba4a15ebcb', '3bf94001-5e9a-40ce-a88f-9294c66494d2', 'c0ca7eaa-c3de-444d-9efc-c99e49e8204a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:21 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:21 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:21 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.297s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Deleted volume successfully. Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e93363d2-aef6-4078-8f8d-544940ee1479 tempest-VolumesActionsTest-1022888637 None] Lock "cinder-232cfa84-a406-48be-829f-6f8763acc2bf-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:21 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 1073741824" returned: 0 in 0.597s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:22 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 Aug 03 08:55:22 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:22 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b676fa-cc64-460e-bd1c-895c95a4dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2164d60-67eb-4a88-b6a7-e9ec18974034', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81afa77e-5520-4b8a-a165-15a43692939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Volume volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 (d2164d60-67eb-4a88-b6a7-e9ec18974034): created successfully Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81afa77e-5520-4b8a-a165-15a43692939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (5f6d415e-edd9-48f8-bdd2-c0e2766748b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (310b59f7-a9a9-43ae-a8d1-e971504d24c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232e4287-39c3-4037-b146-740764fffccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232e4287-39c3-4037-b146-740764fffccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534738542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eed004c-bfe8-4ce3-9423-8ba3ea644fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:22Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a78bc89-d752-4144-945d-0e614fbfad9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a78bc89-d752-4144-945d-0e614fbfad9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f192ef4-03d5-4088-be3d-a8f3cdb2b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f192ef4-03d5-4088-be3d-a8f3cdb2b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eed004c-bfe8-4ce3-9423-8ba3ea644fd8', 'volume_name': 'volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77675774-53cd-4bf0-880b-ec552affb7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77675774-53cd-4bf0-880b-ec552affb7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9f9aac-c1de-4f85-af6a-3b2741ab942d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume 2eed004c-bfe8-4ce3-9423-8ba3ea644fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8', 'volume_size': 1} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1534738542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eed004c-bfe8-4ce3-9423-8ba3ea644fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:22Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume 2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:22 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7964b64e-519d-4d63-a361-8ac0af99b673 tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:55:22 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 1073741824 Aug 03 08:55:22 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-d2164d60-67eb-4a88-b6a7-e9ec18974034-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-d2164d60-67eb-4a88-b6a7-e9ec18974034-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "cinder-quobyte-d2164d60-67eb-4a88-b6a7-e9ec18974034" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-d2164d60-67eb-4a88-b6a7-e9ec18974034" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[419b35a8-814e-4d4d-ad74-bac8ae62eade]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (4e396a9d-0c28-45ad-a503-8e695ca38d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ea87fb-bb7b-431a-bb72-80fb3bba6bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ea87fb-bb7b-431a-bb72-80fb3bba6bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1599875440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:23Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858439d6-d5c1-4dca-aff4-2e8f8023348f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858439d6-d5c1-4dca-aff4-2e8f8023348f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94615e2a-da5e-4515-ac70-35ac2b17ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94615e2a-da5e-4515-ac70-35ac2b17ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee', 'volume_name': 'volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:23 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 Aug 03 08:55:23 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271befe2-60cc-405d-a30f-ebb4d5f31722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (271befe2-60cc-405d-a30f-ebb4d5f31722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ad8145-cd9a-4ceb-9c5d-a9d8acb29475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee', 'volume_size': 1} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:23 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 1073741824" returned: 0 in 0.893s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 Aug 03 08:55:23 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034" returned: 0 in 0.641s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034 Aug 03 08:55:23 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (dbf45932-e4ba-4ce8-870d-95853abbf84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b071ac2f-ca20-4b5a-b19a-415e3164120f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:23 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1599875440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:23Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:23 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b071ac2f-ca20-4b5a-b19a-415e3164120f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54430782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:24Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:23 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee 1073741824 Aug 03 08:55:23 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ec8d9b-b58b-4a1c-b11c-3f36c91f47c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ec8d9b-b58b-4a1c-b11c-3f36c91f47c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e86595-64c9-4d06-a208-45582cd913cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e86595-64c9-4d06-a208-45582cd913cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6', 'volume_name': 'volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1237a1-1b63-4f7c-8df9-c3c04aad7ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1237a1-1b63-4f7c-8df9-c3c04aad7ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d0f263-cbd9-414a-9984-05c9c652cfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume 50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6', 'volume_size': 1} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9f9aac-c1de-4f85-af6a-3b2741ab942d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4437d961-1ee6-412b-9003-7eaca7ec1b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 (2eed004c-bfe8-4ce3-9423-8ba3ea644fd8): created successfully Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4437d961-1ee6-412b-9003-7eaca7ec1b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (310b59f7-a9a9-43ae-a8d1-e971504d24c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0c8def28-2f80-450f-8228-bfab2b82ab47 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:24 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d2164d60-67eb-4a88-b6a7-e9ec18974034" returned: 0 in 0.717s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-quobyte-d2164d60-67eb-4a88-b6a7-e9ec18974034" released by "delete_volume" :: held 1.482s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Created reservations ['1a5b6894-7d0d-476c-a108-ba4d86ec1218', '957764eb-7cd4-4492-9da8-aa107c457c70', '60b79558-6f65-4978-9bdf-4dcbb1db13b9', '56d1b122-48f8-45d5-ab43-a9480a03aee9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (6c993014-2ab1-46bc-a662-cd22001225a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f1317b-fcff-4cf9-8da4-30701a43590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f1317b-fcff-4cf9-8da4-30701a43590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346307467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cd0e27-57e1-4451-914e-d5350cfab064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:25Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cabdc70-8f3d-4d2d-8673-d138e0f86c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cabdc70-8f3d-4d2d-8673-d138e0f86c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624d85a-5a04-47f8-9c5e-41b5b225e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e624d85a-5a04-47f8-9c5e-41b5b225e649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cd0e27-57e1-4451-914e-d5350cfab064', 'volume_name': 'volume-c7cd0e27-57e1-4451-914e-d5350cfab064', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b64c61c-0446-4127-abbe-e6fdb0039779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b64c61c-0446-4127-abbe-e6fdb0039779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb37c6a-0768-4e21-92c0-4f3428ddea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume c7cd0e27-57e1-4451-914e-d5350cfab064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cd0e27-57e1-4451-914e-d5350cfab064', 'volume_size': 1} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:24 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:24 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee 1073741824" returned: 0 in 0.990s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:24 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:25 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee Aug 03 08:55:25 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (240fe080-8abe-4f96-b14a-24f79e55e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a73db-8d9e-40a4-96e9-2aaec47f19ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82a73db-8d9e-40a4-96e9-2aaec47f19ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254515424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c595b0-9d92-459e-a79f-c3713462ae22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:25Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c5bbc-0651-4aa9-ac90-355b2b37176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (770c5bbc-0651-4aa9-ac90-355b2b37176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11acf9fc-f854-40cb-bc5c-45723b7ae687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11acf9fc-f854-40cb-bc5c-45723b7ae687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3c595b0-9d92-459e-a79f-c3713462ae22', 'volume_name': 'volume-e3c595b0-9d92-459e-a79f-c3713462ae22', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b17e7f-b3b7-425c-91cb-ffcf2174fd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b17e7f-b3b7-425c-91cb-ffcf2174fd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2b1ecf-7d4d-4073-82a6-b74d92cbc8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume e3c595b0-9d92-459e-a79f-c3713462ae22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3c595b0-9d92-459e-a79f-c3713462ae22', 'volume_size': 1} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.557s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Deleted volume successfully. Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3f80e04f-9f00-4743-83e3-6c5665a69b35 tempest-VolumesActionsTest-1210912860 None] Lock "cinder-d2164d60-67eb-4a88-b6a7-e9ec18974034-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:25 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" returned: 0 in 0.638s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-54430782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:24Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume 50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:25 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 1073741824 Aug 03 08:55:25 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ad8145-cd9a-4ceb-9c5d-a9d8acb29475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be718ef-3500-4e9b-949f-760cbdcfc281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee (c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee): created successfully Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6be718ef-3500-4e9b-949f-760cbdcfc281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (4e396a9d-0c28-45ad-a503-8e695ca38d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8635426e-6c79-45b0-bbb8-e9abc7f9a1e0 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (f59f0800-0353-430b-96d5-fbf22ecfb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042234ab-1b78-40c4-b0e2-34c9f433b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042234ab-1b78-40c4-b0e2-34c9f433b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-236803616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b23f6b9-41c1-4814-a848-deb305254ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:26Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5ab32f-7386-4b64-b7b5-50d3ed853186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a5ab32f-7386-4b64-b7b5-50d3ed853186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a7c89f-111f-464f-aa55-e7b39bcc0f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a7c89f-111f-464f-aa55-e7b39bcc0f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b23f6b9-41c1-4814-a848-deb305254ffd', 'volume_name': 'volume-4b23f6b9-41c1-4814-a848-deb305254ffd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf29ba7-e6ae-4763-9d0c-a8588ab9296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf29ba7-e6ae-4763-9d0c-a8588ab9296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:26 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67022aa8-5186-4af2-ac61-d69eae9e7574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Volume 4b23f6b9-41c1-4814-a848-deb305254ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b23f6b9-41c1-4814-a848-deb305254ffd', 'volume_size': 1} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 1073741824" returned: 0 in 0.897s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:26 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 Aug 03 08:55:26 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:27 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" returned: 0 in 0.544s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.365s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-346307467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cd0e27-57e1-4451-914e-d5350cfab064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:25Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume c7cd0e27-57e1-4451-914e-d5350cfab064 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d0f263-cbd9-414a-9984-05c9c652cfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:27 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 1073741824 Aug 03 08:55:27 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c67f4e-9413-4b15-a532-742e84ca69e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:27 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 (50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6): created successfully Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98c67f4e-9413-4b15-a532-742e84ca69e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (dbf45932-e4ba-4ce8-870d-95853abbf84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-283fa31e-b0ab-4f3d-b48e-011aa113da63 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:27 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 1073741824" returned: 0 in 0.721s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:27 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 Aug 03 08:55:27 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:28 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (0e4839b9-c026-42e9-bcef-dcc48b73a204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754308e8-0538-4777-a8fe-e221260fdd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064" returned: 0 in 0.454s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.962s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-254515424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3c595b0-9d92-459e-a79f-c3713462ae22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8a095f759a54423a2888651b9488831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:25Z,use_quota=True,user_id='69c0b4b3ad234e279d5db7148442e39d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Creating volume e3c595b0-9d92-459e-a79f-c3713462ae22 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:28 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (754308e8-0538-4777-a8fe-e221260fdd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1832270752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24429419-be48-4191-8f1c-c422a84243f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:28Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79575a2f-925f-45fa-8051-76c03e488bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79575a2f-925f-45fa-8051-76c03e488bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 1073741824 Aug 03 08:55:28 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef9a0f7-562a-495f-86be-53bfa82adca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef9a0f7-562a-495f-86be-53bfa82adca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24429419-be48-4191-8f1c-c422a84243f5', 'volume_name': 'volume-24429419-be48-4191-8f1c-c422a84243f5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a37588-6fbf-45fb-9121-ae095b667356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4a37588-6fbf-45fb-9121-ae095b667356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b0f582-3df4-498f-afb9-980b461bc95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Volume 24429419-be48-4191-8f1c-c422a84243f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24429419-be48-4191-8f1c-c422a84243f5', 'volume_size': 1} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb37c6a-0768-4e21-92c0-4f3428ddea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cd0e27-57e1-4451-914e-d5350cfab064', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6bef74-3d38-4868-982a-e2dbd913d78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-c7cd0e27-57e1-4451-914e-d5350cfab064 (c7cd0e27-57e1-4451-914e-d5350cfab064): created successfully Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f6bef74-3d38-4868-982a-e2dbd913d78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (6c993014-2ab1-46bc-a662-cd22001225a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7555140d-b955-4ebb-8926-c9f20cdf93e1 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:28 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 1073741824" returned: 0 in 0.495s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:28 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 Aug 03 08:55:28 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:29 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.678s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-236803616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b23f6b9-41c1-4814-a848-deb305254ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8346c65519dd4e1dbd8a4e04d9b2f487',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:26Z,use_quota=True,user_id='e05cc4397a90480c8964a99a81579f9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Creating volume 4b23f6b9-41c1-4814-a848-deb305254ffd {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2b1ecf-7d4d-4073-82a6-b74d92cbc8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3c595b0-9d92-459e-a79f-c3713462ae22', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:29 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd 1073741824 Aug 03 08:55:29 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68afaf1-319f-4b8e-9f93-a46e818566bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Volume volume-e3c595b0-9d92-459e-a79f-c3713462ae22 (e3c595b0-9d92-459e-a79f-c3713462ae22): created successfully Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68afaf1-319f-4b8e-9f93-a46e818566bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Flow 'volume_create_manager' (240fe080-8abe-4f96-b14a-24f79e55e60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9cc50541-353c-46e0-8c5e-11c97499d0ba tempest-CreateVolumesFromSnapshotTest-637795860 None] Created volume successfully. Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-e3c595b0-9d92-459e-a79f-c3713462ae22-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-e3c595b0-9d92-459e-a79f-c3713462ae22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:29 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd 1073741824" returned: 0 in 0.574s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-e3c595b0-9d92-459e-a79f-c3713462ae22" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-e3c595b0-9d92-459e-a79f-c3713462ae22" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:29 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd Aug 03 08:55:29 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1da903-1e4e-483e-9806-782fb335e480]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:30 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 Aug 03 08:55:30 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:30 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd" returned: 0 in 0.289s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1832270752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24429419-be48-4191-8f1c-c422a84243f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:28Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Creating volume 24429419-be48-4191-8f1c-c422a84243f5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67022aa8-5186-4af2-ac61-d69eae9e7574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b23f6b9-41c1-4814-a848-deb305254ffd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c72546e-0393-4020-8725-e770f79e4909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:30 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 1073741824 Aug 03 08:55:30 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Volume volume-4b23f6b9-41c1-4814-a848-deb305254ffd (4b23f6b9-41c1-4814-a848-deb305254ffd): created successfully Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c72546e-0393-4020-8725-e770f79e4909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Flow 'volume_create_manager' (f59f0800-0353-430b-96d5-fbf22ecfb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9ca9aaf1-b089-46e9-b18f-a3b883e1f8be tempest-VolumesActionsTest-388507239 None] Created volume successfully. Aug 03 08:55:30 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22" returned: 0 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:30 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22 Aug 03 08:55:30 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:30 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3c595b0-9d92-459e-a79f-c3713462ae22" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:30 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-e3c595b0-9d92-459e-a79f-c3713462ae22" released by "delete_volume" :: held 0.893s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 1073741824" returned: 0 in 0.595s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:30 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 Aug 03 08:55:30 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:30 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['75165060-36b9-49f6-8cc3-0934ded0c818', '15d66c35-b039-4ccc-a76a-43bc1fccc98e', 'cb1266e7-f403-4f73-8855-9e74a2e75adf', 'e2308430-bae7-4ce3-8622-3f8fd8098ecc'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:31 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:31 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:31 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b0f582-3df4-498f-afb9-980b461bc95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24429419-be48-4191-8f1c-c422a84243f5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f43819-1133-42f4-8f8e-ed6cae2f7da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Volume volume-24429419-be48-4191-8f1c-c422a84243f5 (24429419-be48-4191-8f1c-c422a84243f5): created successfully Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f43819-1133-42f4-8f8e-ed6cae2f7da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (0e4839b9-c026-42e9-bcef-dcc48b73a204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cd002add-1f23-4147-b4f9-17a75141fffb tempest-AttachVolumeNegativeTest-919177382 None] Created volume successfully. Aug 03 08:55:31 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4006d7a-d47a-4885-8cfa-8d4e216b1dd6 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-e3c595b0-9d92-459e-a79f-c3713462ae22-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-4b23f6b9-41c1-4814-a848-deb305254ffd-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "cinder-4b23f6b9-41c1-4814-a848-deb305254ffd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Acquiring lock "cinder-quobyte-4b23f6b9-41c1-4814-a848-deb305254ffd" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "cinder-quobyte-4b23f6b9-41c1-4814-a848-deb305254ffd" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[58525c51-fa00-45aa-81b7-61d2d74329d4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Flow 'volume_create_manager' (12c4a918-51e4-46f2-be11-4a3df4613481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca7e21-1443-41ee-aced-c9072ed8eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ca7e21-1443-41ee-aced-c9072ed8eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-689814746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c7c377-521d-4093-91a7-d8088e8b41bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45d66a84dd24aeb99f19ae340679ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:32Z,use_quota=True,user_id='ad644ee330e343cabd51582219d34862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcf8fbb-d2a4-469f-bee3-f7b76b85a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcf8fbb-d2a4-469f-bee3-f7b76b85a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8559182-4a63-40e8-88e3-2371aed208fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8559182-4a63-40e8-88e3-2371aed208fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c7c377-521d-4093-91a7-d8088e8b41bb', 'volume_name': 'volume-a6c7c377-521d-4093-91a7-d8088e8b41bb', 'volume_size': 2}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58baa42-037e-4f63-ba80-3ce5086b0f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58baa42-037e-4f63-ba80-3ce5086b0f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f84f8c-ccc8-44b5-bac9-e5d9da8d11f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Volume a6c7c377-521d-4093-91a7-d8088e8b41bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c7c377-521d-4093-91a7-d8088e8b41bb', 'volume_size': 2} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-689814746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c7c377-521d-4093-91a7-d8088e8b41bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e45d66a84dd24aeb99f19ae340679ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:32Z,use_quota=True,user_id='ad644ee330e343cabd51582219d34862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Creating volume a6c7c377-521d-4093-91a7-d8088e8b41bb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:31 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb 2147483648 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:31 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd Aug 03 08:55:31 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:31 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb 2147483648 Aug 03 08:55:31 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd Aug 03 08:55:32 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-c7cd0e27-57e1-4451-914e-d5350cfab064-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-c7cd0e27-57e1-4451-914e-d5350cfab064-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-c7cd0e27-57e1-4451-914e-d5350cfab064" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-c7cd0e27-57e1-4451-914e-d5350cfab064" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[077fae97-72e9-480f-9156-5d1373aa6aaa]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4b23f6b9-41c1-4814-a848-deb305254ffd" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 Aug 03 08:55:32 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "cinder-quobyte-4b23f6b9-41c1-4814-a848-deb305254ffd" released by "delete_volume" :: held 0.871s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:32 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb 2147483648" returned: 0 in 0.719s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Created reservations ['5a432222-9d38-4eea-a21d-dd274d4763d3', '0d9c16bd-bcee-41ef-8b73-7bfa0675a14f', 'd27c2836-9b35-4786-ada3-f531d688ad31', '9e74f05b-51d1-4e3f-b0c4-47f2d1a0c45a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:32 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb Aug 03 08:55:32 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:32 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10d109f0-cfbf-402c-bf42-eb50149c5f09 req-84d8e1d3-5cce-4fd8-b25e-482468384920 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:32 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:32 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064 Aug 03 08:55:32 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:32 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10d109f0-cfbf-402c-bf42-eb50149c5f09 req-84d8e1d3-5cce-4fd8-b25e-482468384920 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.122s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-10d109f0-cfbf-402c-bf42-eb50149c5f09 req-84d8e1d3-5cce-4fd8-b25e-482468384920 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f84f8c-ccc8-44b5-bac9-e5d9da8d11f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c7c377-521d-4093-91a7-d8088e8b41bb', 'volume_size': 2}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcece11a-2f0b-4e48-bd8b-d2c54330a9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Volume volume-a6c7c377-521d-4093-91a7-d8088e8b41bb (a6c7c377-521d-4093-91a7-d8088e8b41bb): created successfully Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcece11a-2f0b-4e48-bd8b-d2c54330a9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Flow 'volume_create_manager' (12c4a918-51e4-46f2-be11-4a3df4613481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-10d109f0-cfbf-402c-bf42-eb50149c5f09 req-84d8e1d3-5cce-4fd8-b25e-482468384920 tempest-AttachVolumeNegativeTest-919177382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-24429419-be48-4191-8f1c-c422a84243f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c81b8785-cae6-4f60-89ce-b0d00a523f85', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:55:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-44b911d2-6d19-41a5-94f5-25e8fdf03553 tempest-VolumesCloneNegativeTest-297131470 None] Created volume successfully. Aug 03 08:55:32 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:32 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Deleted volume successfully. Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-631dffec-5b1b-4378-b1cc-42eeb0fb3c01 tempest-VolumesActionsTest-388507239 None] Lock "cinder-4b23f6b9-41c1-4814-a848-deb305254ffd-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-10d109f0-cfbf-402c-bf42-eb50149c5f09 req-84d8e1d3-5cce-4fd8-b25e-482468384920 tempest-AttachVolumeNegativeTest-919177382 None] attachment_update completed successfully. Aug 03 08:55:33 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7cd0e27-57e1-4451-914e-d5350cfab064" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-c7cd0e27-57e1-4451-914e-d5350cfab064" released by "delete_volume" :: held 0.898s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['a96432d5-51d1-462d-af15-7ded555f429b', '9cd27839-867d-49d4-8464-2fc3dab4810b', 'c89fdc13-58b8-43c3-9d78-c77d39a472ac', 'c31251d8-8ba4-4a10-97b1-fc1a3392f4f2'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:33 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:33 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e257f4e-cb21-4a85-ba8f-03be18a4755c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:33 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:33 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 Aug 03 08:55:33 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Acquiring lock "cinder-a6c7c377-521d-4093-91a7-d8088e8b41bb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2ea0d93c-7cda-4a36-a7af-d1f84aa1a97b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-c7cd0e27-57e1-4451-914e-d5350cfab064-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "cinder-a6c7c377-521d-4093-91a7-d8088e8b41bb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Acquiring lock "cinder-quobyte-a6c7c377-521d-4093-91a7-d8088e8b41bb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "cinder-quobyte-a6c7c377-521d-4093-91a7-d8088e8b41bb" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5372d32-5121-41de-b7f3-296427334017]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb Aug 03 08:55:34 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" returned: 0 in 0.675s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6 Aug 03 08:55:34 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb" returned: 0 in 0.546s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6" released by "delete_volume" :: held 1.080s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['de50a160-085f-48ff-9f26-a86e58465f10', 'b2b35bbb-0c91-4030-923d-7ff38a107475', 'd14768a9-786b-4feb-a4a5-d70bb2dcae63', 'b5f4f746-fb6d-4f81-8b47-5ef39a2b7b84'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:34 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:34 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:34 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a6c7c377-521d-4093-91a7-d8088e8b41bb" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "cinder-quobyte-a6c7c377-521d-4093-91a7-d8088e8b41bb" released by "delete_volume" :: held 0.976s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Created reservations ['ad4f9a70-edd8-4734-a715-590eeea2f043', 'ca43216a-ab14-4f3b-bd0c-a4e6f03ca0ea', 'fc6bbe0b-8c9c-4505-9a2f-da8b7e1d0106', 'f7d3a892-8109-45f5-bbbb-3bbe0f98cfec'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:35 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.326s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c040d757-d2b8-4af0-a767-b911de43514f tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-50f6bf7b-c3e3-4e4c-9c6d-6aba2c4921a6-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:35 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:35 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:35 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Deleted volume successfully. Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b2c98315-0b24-4a2a-b3b2-48bc51178e26 tempest-VolumesCloneNegativeTest-297131470 None] Lock "cinder-a6c7c377-521d-4093-91a7-d8088e8b41bb-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[502fac99-f656-4a5f-9c87-f9ca50ba384a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:36 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee Aug 03 08:55:36 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" returned: 0 in 0.554s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:36 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee Aug 03 08:55:36 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-abe0e106-bd12-4580-8a80-c173209cd35d req-3b770008-6c01-4545-8ddd-1ef4248c88ee tempest-AttachVolumeNegativeTest-919177382 None] Terminate volume connection completed successfully. Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-abe0e106-bd12-4580-8a80-c173209cd35d req-3b770008-6c01-4545-8ddd-1ef4248c88ee tempest-AttachVolumeNegativeTest-919177382 None] Deleting attachment c81b8785-cae6-4f60-89ce-b0d00a523f85. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:55:36 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" returned: 0 in 0.434s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee" released by "delete_volume" :: held 1.050s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['79fddd26-728d-41c7-8e1c-914d07722151', 'a322be5d-fbf4-421c-8aba-900a95a5e173', 'a2fbcdf7-e7dc-44ff-ba02-df69911c5df4', 'a0a6aba8-e0b5-4831-a5d9-e3792f59d3cb'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:37 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:37 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:37 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1cf1a0c7-3ec0-4073-afbd-802857806ebf tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-c7b6e2f3-7b32-4a0f-a6ba-d5c4b434b0ee-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f279f4-f932-44ff-a6b8-08f6e0f91fd7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 Aug 03 08:55:38 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:38 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" returned: 0 in 0.532s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:38 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8 Aug 03 08:55:38 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:39 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" returned: 0 in 0.494s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8" released by "delete_volume" :: held 1.135s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['d81f459a-f863-46dd-ac92-09d1c912cfeb', 'f613b3f9-b205-4a88-9089-571696f1d172', '071b23d0-8f0b-4cfc-9d15-7a9ee03686d9', '78d717af-7e6a-42ce-b983-298b50a20485'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:39 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:39 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:40 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.411s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-eed79157-56c3-47e1-8a13-cc1b25b56e97 tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-2eed004c-bfe8-4ce3-9423-8ba3ea644fd8-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-46053413-8201-4fd1-988c-1e02b2d4bce7-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-46053413-8201-4fd1-988c-1e02b2d4bce7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-46053413-8201-4fd1-988c-1e02b2d4bce7" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-46053413-8201-4fd1-988c-1e02b2d4bce7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleting offline snapshot 46053413-8201-4fd1-988c-1e02b2d4bce7 of volume 2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] snapshot_file for this snap is: volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9dd5510-5125-4cbe-883f-0fd9e78fdba4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:40 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 Aug 03 08:55:40 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:41 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7" returned: 0 in 0.539s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1582ea4b-7f88-4b8f-8b25-8fbe879cf463]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[101416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 Aug 03 08:55:41 devstack sudo[101416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (23e6ba22-2b26-48f6-8d5f-a5d478a7e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856ab489-be60-4737-8125-4b27e04b813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (856ab489-be60-4737-8125-4b27e04b813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1594369480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:41Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba1700-dd4e-4842-963a-3648bda2fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba1700-dd4e-4842-963a-3648bda2fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b04113d-cd8d-45ba-89f2-0f4cf2b16b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b04113d-cd8d-45ba-89f2-0f4cf2b16b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d', 'volume_name': 'volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a069f6-934c-4708-b2a9-d2735c037cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a069f6-934c-4708-b2a9-d2735c037cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265fbf59-dfe6-4b6f-8e50-e1621fe3d3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:41 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Volume 5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d', 'volume_size': 1} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1594369480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:41Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Creating volume 5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:41 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d 1073741824 Aug 03 08:55:41 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:41 devstack sudo[101416]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:41 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 Aug 03 08:55:41 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:42 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d 1073741824" returned: 0 in 0.635s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:42 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7" returned: 0 in 0.522s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:42 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7 Aug 03 08:55:42 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:42 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d Aug 03 08:55:42 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:42 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" returned: 0 in 0.351s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:42 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3.46053413-8201-4fd1-988c-1e02b2d4bce7" returned: 0 in 0.430s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (265fbf59-dfe6-4b6f-8e50-e1621fe3d3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8b6499-85e0-4b70-b591-ea7e6c490dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Volume volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d (5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d): created successfully Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8b6499-85e0-4b70-b591-ea7e6c490dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (23e6ba22-2b26-48f6-8d5f-a5d478a7e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-46053413-8201-4fd1-988c-1e02b2d4bce7" released by "_delete_snapshot" :: held 2.203s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" released by "delete_snapshot" :: held 2.249s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-22890e85-9d8a-42ad-b436-77bcb50a3c10 tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:55:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['a4256bae-1bc8-4192-8bbf-8ab0d7776855', 'c1d90e42-efd1-4a7e-8702-71b2c45c1bab', 'e28c0b07-1239-4bf2-87b6-449ec57948fb', '8c702d8c-99d7-4ea2-b8d8-2fe044aeb3aa'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Delete snapshot completed successfully. Aug 03 08:55:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-bf949285-f942-489f-add5-ba553774d40b tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-46053413-8201-4fd1-988c-1e02b2d4bce7-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cecf76-81cb-420f-bffd-0e7d018d3f20]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:44 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 Aug 03 08:55:44 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:44 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" returned: 0 in 0.598s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:44 devstack sudo[101446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3 Aug 03 08:55:44 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (846ceee2-55ad-4d15-973c-55f97ee47038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd3a665-e80d-4be9-9784-f08e0d861e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd3a665-e80d-4be9-9784-f08e0d861e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1821876596',display_name='tempest-VolumesGetTest-Volume-1213780584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed219e4-c841-4d56-a164-5b8f26cb07cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:45Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:45 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3cc0bb-f6b9-47f4-b9f8-9d62a738b0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3cc0bb-f6b9-47f4-b9f8-9d62a738b0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531b609a-4304-4b42-b658-41f1ef5a43c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531b609a-4304-4b42-b658-41f1ef5a43c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed219e4-c841-4d56-a164-5b8f26cb07cc', 'volume_name': 'volume-aed219e4-c841-4d56-a164-5b8f26cb07cc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9210bacd-c7b7-4822-a1d4-4104f59651ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9210bacd-c7b7-4822-a1d4-4104f59651ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22afcec-cb2b-4dea-b00c-ba968d935cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Volume aed219e4-c841-4d56-a164-5b8f26cb07cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed219e4-c841-4d56-a164-5b8f26cb07cc', 'volume_size': 1} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1821876596',display_name='tempest-VolumesGetTest-Volume-1213780584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed219e4-c841-4d56-a164-5b8f26cb07cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:45Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Creating volume aed219e4-c841-4d56-a164-5b8f26cb07cc {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" returned: 0 in 0.513s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:45 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc 1073741824 Aug 03 08:55:45 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-quobyte-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3" released by "delete_volume" :: held 1.230s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Created reservations ['f569296c-b6b9-485e-b0fb-fbac18966c32', 'b8311a30-bd4e-4ba2-abbe-20bba89139ce', '74679a88-450c-47d6-ac89-94931a4b7bd6', '1867863a-591e-4c53-94a4-a10facc20fad'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:45 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:45 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:45 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Deleted volume successfully. Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5b643228-0c16-4469-8ce7-de5eaf176eea tempest-CreateVolumesFromSnapshotTest-637795860 None] Lock "cinder-2fa6b3c1-fb4c-4ec6-9f75-2e93cd1c22f3-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:45 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc 1073741824" returned: 0 in 0.657s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:45 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc Aug 03 08:55:45 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:46 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc" returned: 0 in 0.351s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22afcec-cb2b-4dea-b00c-ba968d935cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed219e4-c841-4d56-a164-5b8f26cb07cc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0548bb5b-820c-42aa-99b5-1f0eb489691c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Volume volume-aed219e4-c841-4d56-a164-5b8f26cb07cc (aed219e4-c841-4d56-a164-5b8f26cb07cc): created successfully Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0548bb5b-820c-42aa-99b5-1f0eb489691c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (846ceee2-55ad-4d15-973c-55f97ee47038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-32229bfb-49c8-4d8a-94b8-09d1c14871cc tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-aed219e4-c841-4d56-a164-5b8f26cb07cc-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "cinder-aed219e4-c841-4d56-a164-5b8f26cb07cc-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-aed219e4-c841-4d56-a164-5b8f26cb07cc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-aed219e4-c841-4d56-a164-5b8f26cb07cc" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[936eb864-e441-4501-9f32-885293328db7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:47 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc Aug 03 08:55:47 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:47 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc" returned: 0 in 0.565s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:48 devstack sudo[101472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc Aug 03 08:55:48 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:48 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aed219e4-c841-4d56-a164-5b8f26cb07cc" returned: 0 in 0.440s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-aed219e4-c841-4d56-a164-5b8f26cb07cc" released by "delete_volume" :: held 1.073s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Created reservations ['792c05e0-4331-4b61-b9d5-fa6f02316e0a', 'b6fd54d9-914e-483f-bb01-ef203dabead9', '9ad39cd1-ca05-45c8-87bc-06cf860b533c', '143389da-f1e5-46b7-b3b6-1679f5dccc74'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:48 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:48 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:48 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.306s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-974a7083-494e-4a8c-8dec-130b4c35be8e tempest-VolumesGetTest-122209321 None] Lock "cinder-aed219e4-c841-4d56-a164-5b8f26cb07cc-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "cinder-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a96c5c-53f3-4eea-987a-1764baca5b69]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:50 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d Aug 03 08:55:50 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" returned: 0 in 0.725s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:50 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d Aug 03 08:55:50 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Flow 'volume_create_manager' (1b98af7c-4c79-49af-991b-291254052b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0929f-633f-43a4-92a9-cbc097bfbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0929f-633f-43a4-92a9-cbc097bfbfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-120817890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdcd33-f114-496a-8516-180cc5efa47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946c858c26294849ad91046b6b4a57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:51Z,use_quota=True,user_id='9b20516896284e139b7eb6cd50b59a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f93100-c644-49eb-8533-5b369f4bc813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f93100-c644-49eb-8533-5b369f4bc813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1b623-1d2e-4951-ac02-4474613c0077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3d1b623-1d2e-4951-ac02-4474613c0077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bfdcd33-f114-496a-8516-180cc5efa47e', 'volume_name': 'volume-5bfdcd33-f114-496a-8516-180cc5efa47e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfc3a7a-7bcf-421c-a4e1-17650a1309ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bfc3a7a-7bcf-421c-a4e1-17650a1309ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267c2b5f-00bb-42c6-97b2-4a42284a0ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Volume 5bfdcd33-f114-496a-8516-180cc5efa47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bfdcd33-f114-496a-8516-180cc5efa47e', 'volume_size': 1} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-120817890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bfdcd33-f114-496a-8516-180cc5efa47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946c858c26294849ad91046b6b4a57e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:51Z,use_quota=True,user_id='9b20516896284e139b7eb6cd50b59a62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Creating volume 5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:50 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:50 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e 1073741824 Aug 03 08:55:50 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:50 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d" released by "delete_volume" :: held 1.156s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Created reservations ['5729d7aa-0474-4c8c-8a03-ba937645b411', 'b2d1fa14-114a-48fe-a1b6-97a94d43dd73', '73bc10fe-fa6b-42fd-8ec8-9c466d5479d5', 'af6b2190-8ba4-42f7-865f-bc059b8b322d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:51 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:55:51 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:51 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e 1073741824" returned: 0 in 0.752s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:51 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:55:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffb21891-587e-44fa-93af-1ad8f4480671 tempest-VolumesGetTest-122209321 None] Lock "cinder-5d3af5bd-f3e8-4c54-adef-a0c64a3baa3d-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:51 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e Aug 03 08:55:51 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:51 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267c2b5f-00bb-42c6-97b2-4a42284a0ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bfdcd33-f114-496a-8516-180cc5efa47e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c076fc14-97ea-4a17-bbba-cd5caf9a3a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Volume volume-5bfdcd33-f114-496a-8516-180cc5efa47e (5bfdcd33-f114-496a-8516-180cc5efa47e): created successfully Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c076fc14-97ea-4a17-bbba-cd5caf9a3a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Flow 'volume_create_manager' (1b98af7c-4c79-49af-991b-291254052b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c7e517b2-4a43-41a5-8a80-c6571f8da2f6 tempest-SnapshotMetadataTestJSON-1117232956 None] Created volume successfully. Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (178bdd8f-825c-4cb2-a132-d812fb155ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778f9cd8-b56a-427d-b3aa-008e2c4f67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778f9cd8-b56a-427d-b3aa-008e2c4f67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1356979660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb892650-9a62-4c48-8bca-d5343441df91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:53Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc846c6c-b22e-48d3-9d8e-5214ce551883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc846c6c-b22e-48d3-9d8e-5214ce551883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec84e6c-1173-43b1-9237-8e9360afd011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec84e6c-1173-43b1-9237-8e9360afd011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb892650-9a62-4c48-8bca-d5343441df91', 'volume_name': 'volume-fb892650-9a62-4c48-8bca-d5343441df91', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b132df25-6128-48e2-9b7a-b98d3b8c3600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b132df25-6128-48e2-9b7a-b98d3b8c3600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc96cc2-2460-472f-97ad-98fbc4513dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Volume fb892650-9a62-4c48-8bca-d5343441df91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb892650-9a62-4c48-8bca-d5343441df91', 'volume_size': 1} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1356979660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb892650-9a62-4c48-8bca-d5343441df91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:53Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Creating volume fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:55:52 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:55:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:52 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 1073741824 Aug 03 08:55:52 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:53 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 1073741824" returned: 0 in 0.655s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:53 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:55:53 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:53 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.293s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.857s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Creating offline snapshot 4650f012-9b80-46cd-ad3b-d9cf4d87bad6 of volume 5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc96cc2-2460-472f-97ad-98fbc4513dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb892650-9a62-4c48-8bca-d5343441df91', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844fed9-0164-48c4-a61e-5112717e608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee66c8-8088-4344-a623-bc118f835a57]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Volume volume-fb892650-9a62-4c48-8bca-d5343441df91 (fb892650-9a62-4c48-8bca-d5343441df91): created successfully Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844fed9-0164-48c4-a61e-5112717e608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (178bdd8f-825c-4cb2-a132-d812fb155ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-33102c6c-8f65-47f8-88f5-5703bd84697e tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:55:54 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e Aug 03 08:55:54 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:54 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e" returned: 0 in 0.895s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:54 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 1G Aug 03 08:55:54 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:55 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 1G" returned: 0 in 0.887s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfdcd33-f114-496a-8516-180cc5efa47e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:55 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfdcd33-f114-496a-8516-180cc5efa47e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 Aug 03 08:55:55 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:55 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:55:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (6a403373-b4f5-40d3-8651-e43c0f15439f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:55:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa889bad-2198-4166-970a-ff4b7cf938da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa889bad-2198-4166-970a-ff4b7cf938da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-471215832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31923a3b-4ae3-49f8-948e-a90f5e646662,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:55:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fb892650-9a62-4c48-8bca-d5343441df91,status='creating',terminated_at=None,updated_at=2026-08-03T06:55:56Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c5123e-ff86-4a1e-b52a-5b63070af60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c5123e-ff86-4a1e-b52a-5b63070af60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd79efb6-0ce2-40d7-8a8d-b6976f9847b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd79efb6-0ce2-40d7-8a8d-b6976f9847b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '31923a3b-4ae3-49f8-948e-a90f5e646662', 'volume_name': 'volume-31923a3b-4ae3-49f8-948e-a90f5e646662', 'volume_size': 1, 'source_volid': 'fb892650-9a62-4c48-8bca-d5343441df91', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfc2f76-2b8d-4457-ab41-625c16216df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfc2f76-2b8d-4457-ab41-625c16216df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563723da-8365-4f95-98d2-297d44b75912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:55:56 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Volume 31923a3b-4ae3-49f8-948e-a90f5e646662: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-31923a3b-4ae3-49f8-948e-a90f5e646662', 'volume_size': 1, 'source_volid': 'fb892650-9a62-4c48-8bca-d5343441df91', 'source_volstatus': 'available'} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:55:56 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bfdcd33-f114-496a-8516-180cc5efa47e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6" returned: 0 in 0.561s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:56 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 is being set with open permissions: ugo+rw Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:56 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 Aug 03 08:55:56 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:56 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:56 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info Aug 03 08:55:56 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:57 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info is being set with open permissions: ugo+rw Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:57 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info Aug 03 08:55:57 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:57 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.info" returned: 0 in 0.494s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.624s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.463s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:55:57 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Cloning volume fb892650-9a62-4c48-8bca-d5343441df91 to volume 31923a3b-4ae3-49f8-948e-a90f5e646662 Aug 03 08:55:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9d56c73d-0d48-42a9-9cb7-7fb743d29333 tempest-SnapshotMetadataTestJSON-1117232956 None] Create snapshot completed successfully Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Creating offline snapshot d0e40533-31a6-4aff-8666-35322cbba6e0 of volume fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[921b85c7-127c-4b29-ab8e-128beeeb48ec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:57 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:55:57 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:58 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.534s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:58 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 1G Aug 03 08:55:58 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:59 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 1G" returned: 0 in 0.755s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb892650-9a62-4c48-8bca-d5343441df91 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:59 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb892650-9a62-4c48-8bca-d5343441df91 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:55:59 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:59 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb892650-9a62-4c48-8bca-d5343441df91 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.553s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:55:59 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 is being set with open permissions: ugo+rw Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:55:59 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:55:59 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "cinder-4650f012-9b80-46cd-ad3b-d9cf4d87bad6-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-4650f012-9b80-46cd-ad3b-d9cf4d87bad6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "cinder-quobyte-4650f012-9b80-46cd-ad3b-d9cf4d87bad6" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-4650f012-9b80-46cd-ad3b-d9cf4d87bad6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Deleting offline snapshot 4650f012-9b80-46cd-ad3b-d9cf4d87bad6 of volume 5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] snapshot_file for this snap is: volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04fefb-124f-4eb2-93e6-194b4800dc28]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:55:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:00 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.527s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=173,cinder:DELETE=16,cinder:SELECT=114,cinder:INSERT=33 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=124,cinder:UPDATE=147,cinder:INSERT=41,cinder:DELETE=14 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:00 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 Aug 03 08:56:00 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:00 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info Aug 03 08:56:00 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:00 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6" returned: 0 in 0.688s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bfdcd33-f114-496a-8516-180cc5efa47e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:56:00 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info" returned: 0 in 0.426s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:00 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info is being set with open permissions: ugo+rw Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a63325-0c9b-4a9d-9117-f26f0e15b8de]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:00 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info Aug 03 08:56:00 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:00 devstack sudo[101671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e Aug 03 08:56:00 devstack sudo[101671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:01 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.info" returned: 0 in 0.463s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] snapshot: d0e40533-31a6-4aff-8666-35322cbba6e0, volume: 31923a3b-4ae3-49f8-948e-a90f5e646662, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3ea28-78c4-4ea2-8e8e-c9afc581f4cf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:01 devstack sudo[101671]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e" returned: 0 in 0.700s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:01 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 Aug 03 08:56:01 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (c216b030-b43a-4cdc-bb80-18916064aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed33b9b2-0d82-47f2-880b-ec8db28fcb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:01 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:56:01 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed33b9b2-0d82-47f2-880b-ec8db28fcb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137114443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b622bf-14d1-48df-b0b6-35d63c793bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:01Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bfcbe3-8c3f-4a52-b2ef-6b888ae75351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bfcbe3-8c3f-4a52-b2ef-6b888ae75351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ecba31-2d56-434d-85d6-b50666dbb91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ecba31-2d56-434d-85d6-b50666dbb91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b622bf-14d1-48df-b0b6-35d63c793bec', 'volume_name': 'volume-61b622bf-14d1-48df-b0b6-35d63c793bec', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e128c6-0ce0-4ca6-acce-7d82b94c27e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e128c6-0ce0-4ca6-acce-7d82b94c27e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b741c03-352a-4809-96fb-e2076093b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Volume 61b622bf-14d1-48df-b0b6-35d63c793bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b622bf-14d1-48df-b0b6-35d63c793bec', 'volume_size': 1} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:01 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.575s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb892650-9a62-4c48-8bca-d5343441df91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d52915f-ef76-48cc-8f4d-1903a66d257c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:01 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6" returned: 0 in 0.536s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:01 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6 Aug 03 08:56:01 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:02 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:56:02 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:02 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e.4650f012-9b80-46cd-ad3b-d9cf4d87bad6" returned: 0 in 0.440s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:02 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.562s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-4650f012-9b80-46cd-ad3b-d9cf4d87bad6" released by "_delete_snapshot" :: held 2.597s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" released by "delete_snapshot" :: held 2.638s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:02 devstack sudo[101702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 Aug 03 08:56:02 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Created reservations ['80453c13-95ca-4ead-ae14-2a7f69216bc0', '5a3a0bf0-d45b-4d4d-b15f-f927b5352c7e', '9fb869d0-d982-4419-b2b4-27b9a27d708a', '596b147e-98e8-4612-b876-4945e68228f0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Delete snapshot completed successfully. Aug 03 08:56:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-799a5e0e-654a-49c4-9867-e530262167b5 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-4650f012-9b80-46cd-ad3b-d9cf4d87bad6-delete_snapshot" released by "delete_snapshot" :: held 2.920s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "cinder-5bfdcd33-f114-496a-8516-180cc5efa47e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-5bfdcd33-f114-496a-8516-180cc5efa47e-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" acquired by "delete_volume" :: waited 0.053s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f376c9-fe94-4a54-a65a-355217d1441e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:04 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e Aug 03 08:56:04 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:05 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e" returned: 0 in 1.481s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:05 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e Aug 03 08:56:05 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:06 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5bfdcd33-f114-496a-8516-180cc5efa47e" returned: 0 in 0.935s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-quobyte-5bfdcd33-f114-496a-8516-180cc5efa47e" released by "delete_volume" :: held 2.608s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Created reservations ['c226e43e-506b-4669-b943-8f40be99dd71', '54cadf20-1eb0-445c-b22e-bc9addcf7540', '41495827-dd98-45f8-b6d6-a41d8754b634', '6fa2fd2f-f4c0-42c2-83b6-6776272ad188'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:07 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:07 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:07 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.685s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:07 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Deleted volume successfully. Aug 03 08:56:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-98a7787e-14c1-4617-9c31-c7f7f7ce0b70 tempest-SnapshotMetadataTestJSON-1117232956 None] Lock "cinder-5bfdcd33-f114-496a-8516-180cc5efa47e-delete_volume" released by "delete_volume" :: held 4.054s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:08 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:08 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:09 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662" returned: 0 in 7.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91, size 1024.00 MB, duration 7.28 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:56:09 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Converted 1024.00 MB image at 140.73 MB/s Aug 03 08:56:09 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 is being set with open permissions: ugo+rw Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:09 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.969s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:09 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 Aug 03 08:56:09 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:56:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:56:10 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" released by "_copy_volume_from_snapshot" :: held 8.850s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-d0e40533-31a6-4aff-8666-35322cbba6e0" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-d0e40533-31a6-4aff-8666-35322cbba6e0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Deleting offline snapshot d0e40533-31a6-4aff-8666-35322cbba6e0 of volume fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] snapshot_file for this snap is: volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcfc8ab-1fea-4476-9f89-83457df77f57]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:10 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:56:10 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:10 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.400s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb892650-9a62-4c48-8bca-d5343441df91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e892d3a6-301f-4ef6-aaea-5c972fc5c107]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:10 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:56:10 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:11 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.627s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:11 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:56:11 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:11 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:11 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0 Aug 03 08:56:11 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:11 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91.d0e40533-31a6-4aff-8666-35322cbba6e0" returned: 0 in 0.298s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-d0e40533-31a6-4aff-8666-35322cbba6e0" released by "_delete_snapshot" :: held 1.825s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.421s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.458s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1137114443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b622bf-14d1-48df-b0b6-35d63c793bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:01Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Creating volume 61b622bf-14d1-48df-b0b6-35d63c793bec {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:11 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:12 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec 1073741824 Aug 03 08:56:12 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (563723da-8365-4f95-98d2-297d44b75912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31923a3b-4ae3-49f8-948e-a90f5e646662', 'volume_size': 1, 'source_volid': 'fb892650-9a62-4c48-8bca-d5343441df91', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1ca04f-de7a-4763-8ef6-eff285d9cb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Volume volume-31923a3b-4ae3-49f8-948e-a90f5e646662 (31923a3b-4ae3-49f8-948e-a90f5e646662): created successfully Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1ca04f-de7a-4763-8ef6-eff285d9cb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (6a403373-b4f5-40d3-8651-e43c0f15439f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-92a1bbd0-a8f1-4d6a-8ec6-65c495db6551 tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:56:12 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec 1073741824" returned: 0 in 0.550s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:12 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec Aug 03 08:56:12 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:12 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b741c03-352a-4809-96fb-e2076093b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b622bf-14d1-48df-b0b6-35d63c793bec', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affc77bf-8136-4209-a382-3b2072c5d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Volume volume-61b622bf-14d1-48df-b0b6-35d63c793bec (61b622bf-14d1-48df-b0b6-35d63c793bec): created successfully Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (affc77bf-8136-4209-a382-3b2072c5d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (c216b030-b43a-4cdc-bb80-18916064aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8f1fec38-983d-4ff0-9edd-0f48b1175bf8 tempest-ProjectReaderTests-285571571 None] Created volume successfully. Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (8f58e562-a27c-4a82-a40f-bc6309e69b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893de123-aa5c-4092-90f8-24c5d0b24e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (893de123-aa5c-4092-90f8-24c5d0b24e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128942398',display_name='tempest-VolumesGetTest-Volume-823668794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35db136c-401c-4e63-81c4-3e654fbe3ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:14Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b571a24f-f73f-4f76-bdeb-e7ec47fc7a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b571a24f-f73f-4f76-bdeb-e7ec47fc7a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27be475d-04a8-425c-9ba8-5ae2f3af57e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27be475d-04a8-425c-9ba8-5ae2f3af57e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35db136c-401c-4e63-81c4-3e654fbe3ab5', 'volume_name': 'volume-35db136c-401c-4e63-81c4-3e654fbe3ab5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ef887d-e923-44ed-a63d-9a76153109cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ef887d-e923-44ed-a63d-9a76153109cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35944f71-4151-4923-8e0b-58e036dafcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Volume 35db136c-401c-4e63-81c4-3e654fbe3ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35db136c-401c-4e63-81c4-3e654fbe3ab5', 'volume_size': 1} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1128942398',display_name='tempest-VolumesGetTest-Volume-823668794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35db136c-401c-4e63-81c4-3e654fbe3ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:14Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Creating volume 35db136c-401c-4e63-81c4-3e654fbe3ab5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:13 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:13 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 1073741824 Aug 03 08:56:13 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Flow 'volume_create_manager' (f1b8e9ec-ec01-43b3-8e47-9d912c114eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b09aea-7a44-4fbe-8b3a-a4350e26d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5b09aea-7a44-4fbe-8b3a-a4350e26d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-900408883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3c0756-9172-4c3a-bdcb-3b245296a7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32a6afe2e84473cb607df59d0beadf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:14Z,use_quota=True,user_id='1c3c3dd578e84de88cfe7ca0b8268637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a3cee0-c384-45c3-8b2c-82c267b671ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a3cee0-c384-45c3-8b2c-82c267b671ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66d13bc-74d3-42a0-acee-71494784d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66d13bc-74d3-42a0-acee-71494784d651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a3c0756-9172-4c3a-bdcb-3b245296a7d3', 'volume_name': 'volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9aaa52-6f66-4669-8eb7-0230a7ff31df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9aaa52-6f66-4669-8eb7-0230a7ff31df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362462c4-758d-4370-b71a-a2f488117513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Volume 0a3c0756-9172-4c3a-bdcb-3b245296a7d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3', 'volume_size': 1} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-61b622bf-14d1-48df-b0b6-35d63c793bec-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "cinder-61b622bf-14d1-48df-b0b6-35d63c793bec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-quobyte-61b622bf-14d1-48df-b0b6-35d63c793bec" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-61b622bf-14d1-48df-b0b6-35d63c793bec" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82f495-26e6-481e-87c4-c629d7b0f7bb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:14 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec Aug 03 08:56:14 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:14 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 1073741824" returned: 0 in 0.658s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:14 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 Aug 03 08:56:14 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:14 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec" returned: 0 in 0.409s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:14 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-900408883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a3c0756-9172-4c3a-bdcb-3b245296a7d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32a6afe2e84473cb607df59d0beadf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:14Z,use_quota=True,user_id='1c3c3dd578e84de88cfe7ca0b8268637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Creating volume 0a3c0756-9172-4c3a-bdcb-3b245296a7d3 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:14 devstack sudo[101801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:14 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:14 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35944f71-4151-4923-8e0b-58e036dafcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35db136c-401c-4e63-81c4-3e654fbe3ab5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9bb0b2-7dff-44d8-97f3-380eb588bc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:14 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 1073741824 Aug 03 08:56:14 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Volume volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 (35db136c-401c-4e63-81c4-3e654fbe3ab5): created successfully Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf9bb0b2-7dff-44d8-97f3-380eb588bc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (8f58e562-a27c-4a82-a40f-bc6309e69b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7c7e606d-0d63-4456-a447-b35d5fb37f94 tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:56:15 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-61b622bf-14d1-48df-b0b6-35d63c793bec" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-61b622bf-14d1-48df-b0b6-35d63c793bec" released by "delete_volume" :: held 0.752s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Created reservations ['f0c402a0-8346-4d06-bde9-0cf3f7e9f4ba', '4763f229-9486-4d4a-add4-83f82e1f8863', 'baf60ff0-a9fd-4cd3-8da3-74449fe8cf65', '728df7d4-0faa-470b-97eb-554b22a319d2'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:15 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:15 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:15 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 1073741824" returned: 0 in 0.564s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:15 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 Aug 03 08:56:15 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:15 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Deleted volume successfully. Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ddeba6c-ddf4-456a-a325-7051b4bdd0ec tempest-ProjectReaderTests-285571571 None] Lock "cinder-61b622bf-14d1-48df-b0b6-35d63c793bec-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:15 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (362462c4-758d-4370-b71a-a2f488117513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f559c03-fa08-4950-9602-676670225b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:15 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Volume volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 (0a3c0756-9172-4c3a-bdcb-3b245296a7d3): created successfully Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f559c03-fa08-4950-9602-676670225b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Flow 'volume_create_manager' (f1b8e9ec-ec01-43b3-8e47-9d912c114eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7372b107-fb0c-4374-bddf-2742e21824de tempest-VolumesTransfersTest-1348701894 None] Created volume successfully. Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (16fe7a37-a1f2-435f-8413-edc705b6dd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c27a9-0465-495f-a57f-0d854b8c27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-35db136c-401c-4e63-81c4-3e654fbe3ab5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (595c27a9-0465-495f-a57f-0d854b8c27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862242587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975bc64-e188-4f55-8c1e-bcb74b478eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:16Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9b2aa2-aba0-446e-bf0a-a20acf468a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a9b2aa2-aba0-446e-bf0a-a20acf468a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6b9848-ea68-4ef7-9927-07cbc627cd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6b9848-ea68-4ef7-9927-07cbc627cd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4975bc64-e188-4f55-8c1e-bcb74b478eb2', 'volume_name': 'volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83623042-3d9e-4b42-bfde-3895d7e2dcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83623042-3d9e-4b42-bfde-3895d7e2dcce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fba002-d616-4cee-9727-0c0e9eb28f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Volume 4975bc64-e188-4f55-8c1e-bcb74b478eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2', 'volume_size': 1} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-862242587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975bc64-e188-4f55-8c1e-bcb74b478eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:16Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Creating volume 4975bc64-e188-4f55-8c1e-bcb74b478eb2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:16 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "cinder-35db136c-401c-4e63-81c4-3e654fbe3ab5-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:16 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 1073741824 Aug 03 08:56:16 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-35db136c-401c-4e63-81c4-3e654fbe3ab5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-35db136c-401c-4e63-81c4-3e654fbe3ab5" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[517ab6ca-72d1-4913-8cc3-1352a9c29c26]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:16 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 Aug 03 08:56:16 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:16 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 1073741824" returned: 0 in 0.564s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:16 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 Aug 03 08:56:16 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:16 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:16 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5 Aug 03 08:56:16 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-49822bd3-596e-4c48-a467-e8e1fb4ced45 tempest-VolumesTransfersTest-1921376499 None] Transfer volume completed successfully. Aug 03 08:56:17 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2" returned: 0 in 0.325s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91fba002-d616-4cee-9727-0c0e9eb28f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f22ddf6-82d5-4617-8ff6-553e3edc034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:17 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Volume volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 (4975bc64-e188-4f55-8c1e-bcb74b478eb2): created successfully Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f22ddf6-82d5-4617-8ff6-553e3edc034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (16fe7a37-a1f2-435f-8413-edc705b6dd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-acdab96d-a2f7-41b8-a0c2-ae0be1d7e237 tempest-ProjectReaderTests-285571571 None] Created volume successfully. Aug 03 08:56:17 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-35db136c-401c-4e63-81c4-3e654fbe3ab5" returned: 0 in 0.407s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-35db136c-401c-4e63-81c4-3e654fbe3ab5" released by "delete_volume" :: held 0.963s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Created reservations ['a93d2714-1471-4137-9ca0-8deed7d68bc2', '50e8d375-e50e-4729-b926-4f46c9685427', '2c019c7c-032b-4f77-b2a4-6500db25f845', '4c57e665-1000-4dac-880a-94a12c6ac8c6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:17 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:17 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "cinder-0a3c0756-9172-4c3a-bdcb-3b245296a7d3-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-0a3c0756-9172-4c3a-bdcb-3b245296a7d3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "cinder-quobyte-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-quobyte-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d2565-3244-4e7c-a515-17368620c72c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:17 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:56:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1229a052-f1df-4aec-b88d-c76d404dae5d tempest-VolumesGetTest-122209321 None] Lock "cinder-35db136c-401c-4e63-81c4-3e654fbe3ab5-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:17 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 Aug 03 08:56:17 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" returned: 0 in 0.368s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:18 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3 Aug 03 08:56:18 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-4975bc64-e188-4f55-8c1e-bcb74b478eb2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "cinder-4975bc64-e188-4f55-8c1e-bcb74b478eb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-quobyte-4975bc64-e188-4f55-8c1e-bcb74b478eb2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-4975bc64-e188-4f55-8c1e-bcb74b478eb2" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:18 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e01b147-deb9-41fe-b191-25ce6024179f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-quobyte-0a3c0756-9172-4c3a-bdcb-3b245296a7d3" released by "delete_volume" :: held 0.693s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Created reservations ['cc8078c0-8cd8-4a95-aa4b-0f3472707f93', '2d5a84b0-16a4-4a7d-b88f-134f0541ddac', 'd4d80f97-ec55-44dc-a881-16a2cdca8bc7', 'e446421b-b651-4012-bbfd-4572bbef5f32'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:18 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 Aug 03 08:56:18 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-31923a3b-4ae3-49f8-948e-a90f5e646662-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "cinder-31923a3b-4ae3-49f8-948e-a90f5e646662-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:18 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:18 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e377c69-7262-48c1-beb6-e51f1df2591e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:18 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 Aug 03 08:56:18 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:18 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.289s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Deleted volume successfully. Aug 03 08:56:18 devstack sudo[101857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2 Aug 03 08:56:18 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5a137fd0-345b-4db5-a738-fd1cb5d5e32c tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-0a3c0756-9172-4c3a-bdcb-3b245296a7d3-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:19 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:19 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662 Aug 03 08:56:19 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:19 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4975bc64-e188-4f55-8c1e-bcb74b478eb2" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-4975bc64-e188-4f55-8c1e-bcb74b478eb2" released by "delete_volume" :: held 0.818s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Created reservations ['16b01db6-7cef-4de0-b752-94ac9879bc96', 'c7bb40ba-6264-4810-9118-a37c8b5c0cdd', '79f30074-9fe9-4065-b446-5ecff9b1de52', 'db42b9a8-fefb-4533-a7d9-c2cd83fbce16'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:19 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:19 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:19 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31923a3b-4ae3-49f8-948e-a90f5e646662" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Flow 'volume_create_manager' (1ce5df7a-0deb-4896-97d6-fe2d8ab81b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f443a20-0d4c-4830-919e-61cc5827026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-31923a3b-4ae3-49f8-948e-a90f5e646662" released by "delete_volume" :: held 0.854s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f443a20-0d4c-4830-919e-61cc5827026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-426590837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8108379d-dfa4-4715-80a9-9ef6fd3cfeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32a6afe2e84473cb607df59d0beadf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:19Z,use_quota=True,user_id='1c3c3dd578e84de88cfe7ca0b8268637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9032e3-2bb2-4d74-a246-ebba7462fa3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd9032e3-2bb2-4d74-a246-ebba7462fa3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac182570-e9e7-4e07-9d10-d95b7709e3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac182570-e9e7-4e07-9d10-d95b7709e3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8108379d-dfa4-4715-80a9-9ef6fd3cfeec', 'volume_name': 'volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cb2406-d818-4588-9ea8-88a7e04e77dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cb2406-d818-4588-9ea8-88a7e04e77dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac10c3a-27dd-4f61-9543-deeb86466529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:19 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Volume 8108379d-dfa4-4715-80a9-9ef6fd3cfeec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec', 'volume_size': 1} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-426590837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8108379d-dfa4-4715-80a9-9ef6fd3cfeec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32a6afe2e84473cb607df59d0beadf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:19Z,use_quota=True,user_id='1c3c3dd578e84de88cfe7ca0b8268637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Creating volume 8108379d-dfa4-4715-80a9-9ef6fd3cfeec {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:19 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:19 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec 1073741824 Aug 03 08:56:19 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:19 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Deleted volume successfully. Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Created reservations ['3b752e8c-6d58-46c9-a92e-3d695e0f2437', 'e96bfaeb-af22-4c80-86ba-c1b7ae5bd5f1', '7ddd3b56-d7f9-4b82-9599-1a62fb7a2be6', '94703cb6-5446-4221-a07f-47c18e719b06'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6652ae39-dcc6-4901-b5c9-7943edf7d245 tempest-ProjectReaderTests-285571571 None] Lock "cinder-4975bc64-e188-4f55-8c1e-bcb74b478eb2-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:19 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:19 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (856bbfbf-a9aa-4979-aa3a-cf88d2f1cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806a2c4-a101-46b1-b612-96f5e512475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806a2c4-a101-46b1-b612-96f5e512475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586532544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a15ff5-2495-42c8-ba2a-25f6a440b6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:20Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3fb828-30e2-48f6-8b37-247330251561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3fb828-30e2-48f6-8b37-247330251561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb85268-39e7-4667-af52-14a357bacb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb85268-39e7-4667-af52-14a357bacb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a15ff5-2495-42c8-ba2a-25f6a440b6b3', 'volume_name': 'volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76455e87-4b11-4c1c-aab8-3e4537e6db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76455e87-4b11-4c1c-aab8-3e4537e6db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b314e9-6c45-4b88-bec3-1711d48541ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Volume a8a15ff5-2495-42c8-ba2a-25f6a440b6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3', 'volume_size': 1} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:56:20 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec 1073741824" returned: 0 in 0.557s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5d51645-7a31-4168-98b0-93b19d3985e5 tempest-VolumesGetTest-122209321 None] Lock "cinder-31923a3b-4ae3-49f8-948e-a90f5e646662-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:20 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec Aug 03 08:56:20 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:20 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-586532544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a15ff5-2495-42c8-ba2a-25f6a440b6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:20Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Creating volume a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:20 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac10c3a-27dd-4f61-9543-deeb86466529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 1073741824 Aug 03 08:56:20 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef04cb50-f4b5-4f6b-b4d4-0bb55bd56838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:20 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Volume volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec (8108379d-dfa4-4715-80a9-9ef6fd3cfeec): created successfully Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef04cb50-f4b5-4f6b-b4d4-0bb55bd56838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Flow 'volume_create_manager' (1ce5df7a-0deb-4896-97d6-fe2d8ab81b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2242370b-2b9f-4580-8a7a-a8c9e490d35e tempest-VolumesTransfersTest-1348701894 None] Created volume successfully. Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-fb892650-9a62-4c48-8bca-d5343441df91-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "cinder-fb892650-9a62-4c48-8bca-d5343441df91-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-fb892650-9a62-4c48-8bca-d5343441df91" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-fb892650-9a62-4c48-8bca-d5343441df91" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f626c0-0153-4fbe-87b1-dc9953c6a199]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:21 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 1073741824" returned: 0 in 0.558s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:21 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 Aug 03 08:56:21 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:21 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:56:21 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:21 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10b314e9-6c45-4b88-bec3-1711d48541ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5932748-3abc-4175-9c09-75a85af79f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Volume volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 (a8a15ff5-2495-42c8-ba2a-25f6a440b6b3): created successfully Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5932748-3abc-4175-9c09-75a85af79f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (856bbfbf-a9aa-4979-aa3a-cf88d2f1cced) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-807fcda4-d5e5-47a2-a46d-d1332cc41787 tempest-ProjectReaderTests-285571571 None] Created volume successfully. Aug 03 08:56:21 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.415s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:21 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91 Aug 03 08:56:21 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:21 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fb892650-9a62-4c48-8bca-d5343441df91" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-fb892650-9a62-4c48-8bca-d5343441df91" released by "delete_volume" :: held 0.741s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Created reservations ['5dfcbc02-819c-4a04-815a-792a1ef7efdf', 'e0415e1b-c37e-443f-a639-75ab5ef91bd2', 'dcbb6f5d-d7b7-4cea-968b-d32263cf66cc', '952d2f21-b206-4db0-b070-7c433380f132'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "cinder-8108379d-dfa4-4715-80a9-9ef6fd3cfeec-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-8108379d-dfa4-4715-80a9-9ef6fd3cfeec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:21 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:21 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "cinder-quobyte-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-quobyte-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4591b44c-6220-4055-b8ca-b5f7b38236f9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:22 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec Aug 03 08:56:22 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:22 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-570b4b7e-3055-46d8-8114-0fff10a280bb tempest-VolumesGetTest-122209321 None] Lock "cinder-fb892650-9a62-4c48-8bca-d5343441df91-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "cinder-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-quobyte-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f42f97d-b753-4892-8624-ba986b2fc38a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:22 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" returned: 0 in 0.563s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:22 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 Aug 03 08:56:22 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:22 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec Aug 03 08:56:22 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:22 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" returned: 0 in 0.476s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:22 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:22 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3 Aug 03 08:56:22 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-quobyte-8108379d-dfa4-4715-80a9-9ef6fd3cfeec" released by "delete_volume" :: held 1.048s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Created reservations ['05199e65-9f93-4de9-8742-43acc3adf36c', 'bb8bbedc-2bd0-4124-9554-347a5b3bac27', '7c17359a-599f-48aa-8164-1bf13984f0d0', 'eacdbcef-1c17-4879-a514-ccdd27613f0f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:23 devstack sudo[101920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:23 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (901224a2-f9c7-4efa-9a01-0e41e12c0fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d196f3f-9630-4708-a342-8de0374b72e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d196f3f-9630-4708-a342-8de0374b72e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-535903518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa138b2-40a2-4b4f-8a28-95bba1287487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:23Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a05ab-6a2a-43dd-8304-021de635dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d30a05ab-6a2a-43dd-8304-021de635dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234db7bb-4ea9-42ca-a2a7-f6598b4e072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234db7bb-4ea9-42ca-a2a7-f6598b4e072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa138b2-40a2-4b4f-8a28-95bba1287487', 'volume_name': 'volume-efa138b2-40a2-4b4f-8a28-95bba1287487', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03c89d2-b6cf-4046-bc78-c15ca2a6e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d03c89d2-b6cf-4046-bc78-c15ca2a6e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4952d4e9-7c77-4655-8696-0efa731c971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Volume efa138b2-40a2-4b4f-8a28-95bba1287487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa138b2-40a2-4b4f-8a28-95bba1287487', 'volume_size': 1} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-535903518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa138b2-40a2-4b4f-8a28-95bba1287487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2d2f78c7d5c43ecafa0d3ac1596805b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:23Z,use_quota=True,user_id='74216c92276c4732a38d0b0bfb020c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Creating volume efa138b2-40a2-4b4f-8a28-95bba1287487 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:23 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3" released by "delete_volume" :: held 0.922s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:23 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 1073741824 Aug 03 08:56:23 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (89176397-9d51-4cbd-8083-7c9d87af29bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd551b8-a9c8-4782-a328-3868e5103950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd551b8-a9c8-4782-a328-3868e5103950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728958710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af643a-abad-4c91-8187-e0fa23f08aea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:23Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31eb508-3e5f-46d1-92c9-0825093ea953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31eb508-3e5f-46d1-92c9-0825093ea953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08da86a8-07f3-4005-8647-2688ecfd521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Created reservations ['c1fc3174-4ed8-4b3d-a594-8926da3ed08d', '739fcefd-db1c-4b39-b562-ff8e5bbb33b9', 'dc822523-494b-4ac8-93f6-c811e56ae9a1', '31cdbffb-7b81-4a9b-bc61-9a17f17caa7f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:23 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Deleted volume successfully. Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c79c07b6-693e-4dfe-998a-7550cbbeac1d tempest-VolumesTransfersTest-1829128012 None] Lock "cinder-8108379d-dfa4-4715-80a9-9ef6fd3cfeec-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:23 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:23 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08da86a8-07f3-4005-8647-2688ecfd521d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0af643a-abad-4c91-8187-e0fa23f08aea', 'volume_name': 'volume-f0af643a-abad-4c91-8187-e0fa23f08aea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c617cb39-231b-4ba0-80e0-ea73b7675938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c617cb39-231b-4ba0-80e0-ea73b7675938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3ca7a-37b6-4177-abbc-66c227fbd11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:23 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Volume f0af643a-abad-4c91-8187-e0fa23f08aea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0af643a-abad-4c91-8187-e0fa23f08aea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Trying to clone f0af643a-abad-4c91-8187-e0fa23f08aea from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.314s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 1073741824" returned: 0 in 0.595s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Deleted volume successfully. Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3f71022-0391-46a1-9b16-cb7e516cf9b5 tempest-ProjectReaderTests-285571571 None] Lock "cinder-a8a15ff5-2495-42c8-ba2a-25f6a440b6b3-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:23 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 Aug 03 08:56:23 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:24 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487" returned: 0 in 0.362s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4952d4e9-7c77-4655-8696-0efa731c971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa138b2-40a2-4b4f-8a28-95bba1287487', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e0c4c-2634-4814-81f6-b1707820b782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:56:24 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:56:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Volume volume-efa138b2-40a2-4b4f-8a28-95bba1287487 (efa138b2-40a2-4b4f-8a28-95bba1287487): created successfully Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (878e0c4c-2634-4814-81f6-b1707820b782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Flow 'volume_create_manager' (901224a2-f9c7-4efa-9a01-0e41e12c0fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8720f472-5ec1-4733-af2f-8b8337a952d8 tempest-AttachVolumeNegativeTest-919177382 None] Created volume successfully. Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7dded8-f988-499c-8d77-d44fd929bbce]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:24 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD Aug 03 08:56:24 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:24 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user 5bcc327415024cbd879871332abe0eeb. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0d0d15-eb74-460d-9a05-74043cd71225]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:25 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD Aug 03 08:56:25 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (7ec9744b-283c-4edf-b685-e19263b6036a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e187f4-ae04-4725-b088-c1cf40d30d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83e187f4-ae04-4725-b088-c1cf40d30d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401730789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:25Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76897ac-a23a-4958-aabc-140bfa3f3010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76897ac-a23a-4958-aabc-140bfa3f3010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b479d704-dca5-43a4-874d-9357a964a914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b479d704-dca5-43a4-874d-9357a964a914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296', 'volume_name': 'volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888671d8-448d-4eb8-bcaf-87e55c9c3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (888671d8-448d-4eb8-bcaf-87e55c9c3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67297b67-df4e-4295-800d-75611462b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Volume 3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296', 'volume_size': 1} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401730789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d4a63afb254f3f9a6445f285c2a154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:25Z,use_quota=True,user_id='be405745f49641b5b9d0b5cd807932a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Creating volume 3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:25 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:25 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 1073741824 Aug 03 08:56:25 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:26 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 1073741824" returned: 0 in 0.703s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c706d5c2-7489-428a-a62f-a2964f5afa37 req-13a3bf25-4a5e-40f5-99f2-d2acf8fbc025 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:26 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 Aug 03 08:56:26 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:26 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-728958710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0af643a-abad-4c91-8187-e0fa23f08aea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:23Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Creating volume f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:26 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:26 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1073741824 Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67297b67-df4e-4295-800d-75611462b47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:26 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8866ed1e-4e98-48ca-8c1b-990a0d0750da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Volume volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 (3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296): created successfully Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8866ed1e-4e98-48ca-8c1b-990a0d0750da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Flow 'volume_create_manager' (7ec9744b-283c-4edf-b685-e19263b6036a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e032d7dc-1b13-4e59-a5ff-735da750bacc tempest-ProjectReaderTests-285571571 None] Created volume successfully. Aug 03 08:56:27 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1073741824" returned: 0 in 0.516s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:27 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea Aug 03 08:56:27 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "cinder-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Acquiring lock "cinder-quobyte-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:27 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c706d5c2-7489-428a-a62f-a2964f5afa37 req-13a3bf25-4a5e-40f5-99f2-d2acf8fbc025 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.253s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[922207cd-f517-4d77-8028-8a27129445ec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c706d5c2-7489-428a-a62f-a2964f5afa37 req-13a3bf25-4a5e-40f5-99f2-d2acf8fbc025 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume f0af643a-abad-4c91-8187-e0fa23f08aea. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-c706d5c2-7489-428a-a62f-a2964f5afa37 req-13a3bf25-4a5e-40f5-99f2-d2acf8fbc025 tempest-AttachVolumeNegativeTest-919177382 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-efa138b2-40a2-4b4f-8a28-95bba1287487', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4db1622-5e07-4251-b4ba-cf1902e4de8c', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[55dc0077-32c3-46bb-bfd0-c01ca514137d]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:27 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 Aug 03 08:56:27 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-c706d5c2-7489-428a-a62f-a2964f5afa37 req-13a3bf25-4a5e-40f5-99f2-d2acf8fbc025 tempest-AttachVolumeNegativeTest-919177382 None] attachment_update completed successfully. Aug 03 08:56:27 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf Aug 03 08:56:27 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:28 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" returned: 0 in 0.510s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:28 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296 Aug 03 08:56:28 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:28 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf" returned: 0 in 0.527s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:28 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf Aug 03 08:56:28 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:28 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "cinder-quobyte-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296" released by "delete_volume" :: held 0.969s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Created reservations ['beeaf88e-0144-4e3d-a2d7-699135cd8e6d', '5f02a38c-12e3-4696-a7f7-0181dfb3dcb0', '08153d80-143b-4b72-b776-3a8185014dca', '3d625ccc-fb8f-48f3-8963-d7d5cfcb9f06'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:28 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf" returned: 1 in 0.453s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_kncyojhf' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1dd72b-c403-4727-b1a7-2ecf895af815]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:28 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:28 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:28 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD Aug 03 08:56:28 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:29 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Deleted volume successfully. Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-25ddf80a-5cb5-4e13-ac0d-d1047997d6c7 tempest-ProjectReaderTests-285571571 None] Lock "cinder-3aa0d277-bb9b-4cd0-afc1-2c2e0c60a296-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:29 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD" returned: 0 in 0.546s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:56:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:29 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea Aug 03 08:56:29 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-7539fcfc-b909-4929-9f0a-ebcf0e0cbc46 req-c01ee6a5-6ec3-463a-a075-63703c555e42 tempest-AttachVolumeNegativeTest-919177382 None] Terminate volume connection completed successfully. Aug 03 08:56:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-7539fcfc-b909-4929-9f0a-ebcf0e0cbc46 req-c01ee6a5-6ec3-463a-a075-63703c555e42 tempest-AttachVolumeNegativeTest-919177382 None] Deleting attachment d4db1622-5e07-4251-b4ba-cf1902e4de8c. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:56:31 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea" returned: 0 in 2.758s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7rzhxh6qdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:56:32 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Converted 112.00 MB image at 40.54 MB/s Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:32 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1G Aug 03 08:56:32 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:32 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea 1G" returned: 0 in 0.540s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume f0af643a-abad-4c91-8187-e0fa23f08aea successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user 5bcc327415024cbd879871332abe0eeb is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Marking volume f0af643a-abad-4c91-8187-e0fa23f08aea as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to f0af643a-abad-4c91-8187-e0fa23f08aea. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Creating volume glance metadata for volume f0af643a-abad-4c91-8187-e0fa23f08aea backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f3ca7a-37b6-4177-abbc-66c227fbd11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0af643a-abad-4c91-8187-e0fa23f08aea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b0080a-1628-47dc-869b-ef3a235a173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Volume volume-f0af643a-abad-4c91-8187-e0fa23f08aea (f0af643a-abad-4c91-8187-e0fa23f08aea): created successfully Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b0080a-1628-47dc-869b-ef3a235a173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (89176397-9d51-4cbd-8083-7c9d87af29bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d763d2f1-4d61-4f8b-ab97-10a2a5ce36ee tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (58b1e2a2-3a32-4300-8c5a-1841fe43420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145f0004-dc79-4657-b32b-dc8b491e4b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145f0004-dc79-4657-b32b-dc8b491e4b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1827679606',display_name='tempest-VolumesGetTest-Volume-1712362439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7d551-1954-425b-9e21-96e8d397ee88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:35Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6e5c9c-9f36-4bac-b641-6dc8c8652fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6e5c9c-9f36-4bac-b641-6dc8c8652fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9c22b-0f74-4ce8-a105-7745df8a644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9c22b-0f74-4ce8-a105-7745df8a644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d7d551-1954-425b-9e21-96e8d397ee88', 'volume_name': 'volume-87d7d551-1954-425b-9e21-96e8d397ee88', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7c803a-fff1-4d7d-b3e2-c9ecb640d12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7c803a-fff1-4d7d-b3e2-c9ecb640d12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a83d0-8712-4016-9345-a6a062d741c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Volume 87d7d551-1954-425b-9e21-96e8d397ee88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d7d551-1954-425b-9e21-96e8d397ee88', 'volume_size': 1} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1827679606',display_name='tempest-VolumesGetTest-Volume-1712362439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d7d551-1954-425b-9e21-96e8d397ee88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25fe0eadf61248478cdacac63361fefe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:35Z,use_quota=True,user_id='5bcc327415024cbd879871332abe0eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Creating volume 87d7d551-1954-425b-9e21-96e8d397ee88 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:34 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:34 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 1073741824 Aug 03 08:56:34 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:35 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Flow 'volume_create_manager' (948fb7db-bdb1-4ac3-a38a-ccb10f77a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8817b-96b2-442e-883c-991a1f2163a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 1073741824" returned: 0 in 0.782s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a8817b-96b2-442e-883c-991a1f2163a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-901458020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e5e1a-893e-4600-a2b3-a61a50ecd7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b573a94964bb59d551b1284d17d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:35Z,use_quota=True,user_id='49bc9202241845acbfd2c0db2a64ee21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4aa2ac-266f-4727-9475-b715dccb8bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df4aa2ac-266f-4727-9475-b715dccb8bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a4076a-a982-48ad-8827-b0f7e49d68d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a4076a-a982-48ad-8827-b0f7e49d68d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c7e5e1a-893e-4600-a2b3-a61a50ecd7da', 'volume_name': 'volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09868e92-7a15-459d-a060-e092df3c358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09868e92-7a15-459d-a060-e092df3c358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abbcf5-fc70-4725-a568-07893079c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Volume 7c7e5e1a-893e-4600-a2b3-a61a50ecd7da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da', 'volume_size': 1} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:35 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 Aug 03 08:56:35 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:36 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-901458020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c7e5e1a-893e-4600-a2b3-a61a50ecd7da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b573a94964bb59d551b1284d17d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:35Z,use_quota=True,user_id='49bc9202241845acbfd2c0db2a64ee21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Creating volume 7c7e5e1a-893e-4600-a2b3-a61a50ecd7da {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:36 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a83d0-8712-4016-9345-a6a062d741c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d7d551-1954-425b-9e21-96e8d397ee88', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da 1073741824 Aug 03 08:56:36 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fa8f35-b3ab-4235-91dc-e612fa9e33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:36 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Volume volume-87d7d551-1954-425b-9e21-96e8d397ee88 (87d7d551-1954-425b-9e21-96e8d397ee88): created successfully Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64fa8f35-b3ab-4235-91dc-e612fa9e33aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Flow 'volume_create_manager' (58b1e2a2-3a32-4300-8c5a-1841fe43420b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0e096f62-cda7-44e9-90c0-1138186277cf tempest-VolumesGetTest-122209321 None] Created volume successfully. Aug 03 08:56:36 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da 1073741824" returned: 0 in 0.614s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:36 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da Aug 03 08:56:36 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-87d7d551-1954-425b-9e21-96e8d397ee88-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "cinder-87d7d551-1954-425b-9e21-96e8d397ee88-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-87d7d551-1954-425b-9e21-96e8d397ee88" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-87d7d551-1954-425b-9e21-96e8d397ee88" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac68ba6-9f0f-4fa1-9d10-1968f89ff2b4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:37 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" returned: 0 in 0.525s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08abbcf5-fc70-4725-a568-07893079c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c4a57a-ded7-4aef-81a8-95334cc3a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:37 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Volume volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da (7c7e5e1a-893e-4600-a2b3-a61a50ecd7da): created successfully Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23c4a57a-ded7-4aef-81a8-95334cc3a438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Flow 'volume_create_manager' (948fb7db-bdb1-4ac3-a38a-ccb10f77a472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4c9cc32e-9a66-4eb4-91ec-4e958e112d40 tempest-VolumesTransfersV357Test-551646938 None] Created volume successfully. Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-efa138b2-40a2-4b4f-8a28-95bba1287487-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:37 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 Aug 03 08:56:37 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-efa138b2-40a2-4b4f-8a28-95bba1287487-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-quobyte-efa138b2-40a2-4b4f-8a28-95bba1287487" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-efa138b2-40a2-4b4f-8a28-95bba1287487" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff5697-fa1f-4045-8e72-dffdfcff38dd]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:37 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 Aug 03 08:56:37 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:37 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88" returned: 0 in 0.598s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:37 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88 Aug 03 08:56:37 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:38 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487" returned: 0 in 0.510s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:38 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487 Aug 03 08:56:38 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:38 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-87d7d551-1954-425b-9e21-96e8d397ee88" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-87d7d551-1954-425b-9e21-96e8d397ee88" released by "delete_volume" :: held 1.045s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Created reservations ['39003332-b71e-482d-a359-c63d2045057a', 'cc2d7c10-9610-4ac8-82bb-12311cd86794', 'af62d397-9c53-439f-94a5-aaecd0e0efaa', '7338959b-d622-4783-ad6f-927da51d34ef'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:38 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efa138b2-40a2-4b4f-8a28-95bba1287487" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:38 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:38 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-efa138b2-40a2-4b4f-8a28-95bba1287487" released by "delete_volume" :: held 0.993s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-dbc8c034-3de2-4ab6-aa1f-2c9ba048cb08 tempest-VolumesTransfersV357Test-232188202 None] Transfer volume completed successfully. Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Created reservations ['0cc7cc1c-e9c0-43c8-880a-6afcdceee781', '9462a36c-7f86-4586-8beb-563c37474c67', '5e0e8884-7cd6-423e-9741-f700f55af565', '468fb5f4-604c-406b-8ec8-5ff654e1e1b8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:38 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:38 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:38 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:56:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f1d4929e-e12c-480c-92ab-23c69b92daf0 tempest-VolumesGetTest-122209321 None] Lock "cinder-87d7d551-1954-425b-9e21-96e8d397ee88-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:39 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Deleted volume successfully. Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9269a44-fab6-4775-ad09-eaddae4e6e9f tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-efa138b2-40a2-4b4f-8a28-95bba1287487-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "cinder-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-f0af643a-abad-4c91-8187-e0fa23f08aea-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "cinder-f0af643a-abad-4c91-8187-e0fa23f08aea-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "cinder-quobyte-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-quobyte-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Acquiring lock "cinder-quobyte-f0af643a-abad-4c91-8187-e0fa23f08aea" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d90459-b59a-4363-843c-3a9f9932df39]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-f0af643a-abad-4c91-8187-e0fa23f08aea" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d35aa5-5757-4c59-9c29-070f6a6951d3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:39 devstack sudo[102545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da Aug 03 08:56:39 devstack sudo[102545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:39 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea Aug 03 08:56:39 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-24429419-be48-4191-8f1c-c422a84243f5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-24429419-be48-4191-8f1c-c422a84243f5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-quobyte-24429419-be48-4191-8f1c-c422a84243f5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-24429419-be48-4191-8f1c-c422a84243f5" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:40 devstack sudo[102545]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd29593-a40d-4a57-a724-cebf73d76235]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da Aug 03 08:56:40 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:40 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea" returned: 0 in 0.546s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea Aug 03 08:56:40 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:40 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 Aug 03 08:56:40 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:40 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-quobyte-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da" released by "delete_volume" :: held 0.913s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Created reservations ['1185b42e-43da-47fe-8914-3fd601b7df3e', '9e0dfe39-b1c6-4c12-b8de-aa14ce16f601', 'ee0f7e55-7e83-41f0-bede-80c9deb68768', '8df9230e-ebde-40ba-bdf6-88868eff7f11'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:40 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f0af643a-abad-4c91-8187-e0fa23f08aea" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "cinder-quobyte-f0af643a-abad-4c91-8187-e0fa23f08aea" released by "delete_volume" :: held 0.992s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:40 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5" returned: 0 in 0.580s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:40 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5 Aug 03 08:56:40 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Created reservations ['58f85dfa-951f-49af-bd1f-c7b93ca3f572', '8bd0d364-0bbd-4de5-8529-1340ef463df5', '409fd309-ae34-4936-9fa9-b5c26b0e040b', '45c3f166-270f-4f91-ac88-fa8319fdfad0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:40 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:40 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:40 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:40 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:41 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-24429419-be48-4191-8f1c-c422a84243f5" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:41 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-24429419-be48-4191-8f1c-c422a84243f5" released by "delete_volume" :: held 1.038s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Deleted volume successfully. Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c6389b63-5263-478d-8923-b020a8ddae2c tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-7c7e5e1a-893e-4600-a2b3-a61a50ecd7da-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Created reservations ['fe9f805e-2999-4fa5-8870-0c094bc7498a', '68dbb70c-e287-448c-aea6-019b2e0f60e7', '164f226f-4fbf-4db1-9dee-a0a3ba5cc464', '829aee6e-e1a4-41dc-ace3-916f9f3bbc5a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:41 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Deleted volume successfully. Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-90e4be32-7882-4313-9827-268e642bcbb1 tempest-VolumesGetTest-122209321 None] Lock "cinder-f0af643a-abad-4c91-8187-e0fa23f08aea-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:41 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:41 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:41 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Deleted volume successfully. Aug 03 08:56:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d15c7e09-d2ab-452d-81f4-5dd09138fc35 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-24429419-be48-4191-8f1c-c422a84243f5-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-cbdfe35a-af83-4de3-9c38-a13b1f89b930-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-cbdfe35a-af83-4de3-9c38-a13b1f89b930-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "cinder-quobyte-cbdfe35a-af83-4de3-9c38-a13b1f89b930" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-cbdfe35a-af83-4de3-9c38-a13b1f89b930" acquired by "delete_volume" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Flow 'volume_create_manager' (ad28dc99-ea8c-4056-a613-cb973895fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a09b33-0df1-4a31-939a-b0e09c3e0b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeaf2a44-812d-4afe-9714-b32d9c30aad4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a09b33-0df1-4a31-939a-b0e09c3e0b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2037208313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443f5068-4307-4ac8-b915-7956b75cd185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b573a94964bb59d551b1284d17d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:43Z,use_quota=True,user_id='49bc9202241845acbfd2c0db2a64ee21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2de85a-7bdd-4d8b-b700-b9177b792950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de2de85a-7bdd-4d8b-b700-b9177b792950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28429ce6-988c-426e-a920-1a5d2badd984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28429ce6-988c-426e-a920-1a5d2badd984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443f5068-4307-4ac8-b915-7956b75cd185', 'volume_name': 'volume-443f5068-4307-4ac8-b915-7956b75cd185', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6f968f-63af-423d-bf8c-1d4e5d8cf2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6f968f-63af-423d-bf8c-1d4e5d8cf2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf250bdb-7a65-4cff-8d3f-c5130b93806b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Volume 443f5068-4307-4ac8-b915-7956b75cd185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443f5068-4307-4ac8-b915-7956b75cd185', 'volume_size': 1} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2037208313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443f5068-4307-4ac8-b915-7956b75cd185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a0b573a94964bb59d551b1284d17d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:56:43Z,use_quota=True,user_id='49bc9202241845acbfd2c0db2a64ee21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Creating volume 443f5068-4307-4ac8-b915-7956b75cd185 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:56:42 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:56:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:43 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 Aug 03 08:56:43 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 1073741824 Aug 03 08:56:43 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930" returned: 0 in 0.541s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:43 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930 Aug 03 08:56:43 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 1073741824" returned: 0 in 0.799s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:43 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cbdfe35a-af83-4de3-9c38-a13b1f89b930" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-quobyte-cbdfe35a-af83-4de3-9c38-a13b1f89b930" released by "delete_volume" :: held 1.051s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:43 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 Aug 03 08:56:43 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Created reservations ['df827f14-ad04-48f1-a9d3-dc88fdb3c534', 'ccd25494-4d5c-4ce8-8867-64038c8a6759', '0be3b285-d169-4a03-a742-3e189b7ac322', '74b41d65-8b5a-4b06-8489-7d7bb6b6834e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:44 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:44 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:44 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.313s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf250bdb-7a65-4cff-8d3f-c5130b93806b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443f5068-4307-4ac8-b915-7956b75cd185', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe043725-9a64-483b-a529-64e75a35414e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:56:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Volume volume-443f5068-4307-4ac8-b915-7956b75cd185 (443f5068-4307-4ac8-b915-7956b75cd185): created successfully Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe043725-9a64-483b-a529-64e75a35414e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Flow 'volume_create_manager' (ad28dc99-ea8c-4056-a613-cb973895fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:56:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-547dd792-2cda-43e4-aac6-9fc10c32fc5a tempest-VolumesTransfersV357Test-551646938 None] Created volume successfully. Aug 03 08:56:44 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Deleted volume successfully. Aug 03 08:56:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6a4a2b7b-50f3-469d-911a-f1dbcc268812 tempest-AttachVolumeNegativeTest-919177382 None] Lock "cinder-cbdfe35a-af83-4de3-9c38-a13b1f89b930-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "cinder-443f5068-4307-4ac8-b915-7956b75cd185-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-443f5068-4307-4ac8-b915-7956b75cd185-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "cinder-quobyte-443f5068-4307-4ac8-b915-7956b75cd185" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-quobyte-443f5068-4307-4ac8-b915-7956b75cd185" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[460dce90-1820-4b0e-bb50-bb4861adfe33]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:45 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 Aug 03 08:56:45 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:45 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185" returned: 0 in 0.442s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:45 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185 Aug 03 08:56:45 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:46 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-443f5068-4307-4ac8-b915-7956b75cd185" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-quobyte-443f5068-4307-4ac8-b915-7956b75cd185" released by "delete_volume" :: held 0.808s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Created reservations ['38d15d94-68f4-48fb-a135-aae05b90397d', '34554527-30d0-44a2-92d9-02f91e0e1cc5', 'd5a9036c-622b-4e5a-ae35-0e9c2cfd3f59', '6bb5bd54-42d6-4fda-951b-8a243a0a0ec7'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:56:46 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:56:46 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:56:46 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:56:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Deleted volume successfully. Aug 03 08:56:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fbed996e-10c6-4830-9dcd-2f40eeeba332 tempest-VolumesTransfersV357Test-2102738401 None] Lock "cinder-443f5068-4307-4ac8-b915-7956b75cd185-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:56:56 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=144,cinder:INSERT=50,cinder:UPDATE=173,cinder:DELETE=16 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:56 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=121,cinder:INSERT=49,cinder:UPDATE=196,cinder:DELETE=14 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:56:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8fc350fc-49c6-4b34-8748-95f43d86ebf0 tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-1491539418: creating Aug 03 08:56:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8fc350fc-49c6-4b34-8748-95f43d86ebf0 tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-1491539418: created successfully Aug 03 08:56:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8fc350fc-49c6-4b34-8748-95f43d86ebf0 tempest-GroupSnapshotsTest-1885794825 None] Create group completed successfully. Aug 03 08:57:00 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (3f888700-34b9-4d6f-a70b-388a557b52ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf8b503-b160-4b27-9639-4e04055e8b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf8b503-b160-4b27-9639-4e04055e8b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916434230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f732e8c8-1db9-401b-bd59-3463d734fe94,host='devstack@QuobyteHD#QuobyteHD',id=ef54663c-4c91-4298-a75e-bb99491fb943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:01Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e71a22b-0b64-4b58-be74-2dbf8995cede),volume_type_id=2e71a22b-0b64-4b58-be74-2dbf8995cede)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1b7b0b-6efe-41b4-b168-52b94aa924c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1b7b0b-6efe-41b4-b168-52b94aa924c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9291e8-6008-475b-8f00-a3a6d65540b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e9291e8-6008-475b-8f00-a3a6d65540b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef54663c-4c91-4298-a75e-bb99491fb943', 'volume_name': 'volume-ef54663c-4c91-4298-a75e-bb99491fb943', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14847667-1b80-4dae-ae7c-a980601d7b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14847667-1b80-4dae-ae7c-a980601d7b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e0b5fc-29c3-4a0d-841e-46ac7602beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Volume ef54663c-4c91-4298-a75e-bb99491fb943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef54663c-4c91-4298-a75e-bb99491fb943', 'volume_size': 1} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f732e8c8-1db9-401b-bd59-3463d734fe94,created_at=2026-08-03T06:57:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1916434230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f732e8c8-1db9-401b-bd59-3463d734fe94,host='devstack@QuobyteHD#QuobyteHD',id=ef54663c-4c91-4298-a75e-bb99491fb943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:01Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e71a22b-0b64-4b58-be74-2dbf8995cede),volume_type_id=2e71a22b-0b64-4b58-be74-2dbf8995cede)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Creating volume ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:01 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:01 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 1073741824 Aug 03 08:57:01 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:01 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 1073741824" returned: 0 in 0.606s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:01 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:01 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:02 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7e0b5fc-29c3-4a0d-841e-46ac7602beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef54663c-4c91-4298-a75e-bb99491fb943', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b4de36-752c-4f9b-a2ec-d0490c02ea28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:02 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Volume volume-ef54663c-4c91-4298-a75e-bb99491fb943 (ef54663c-4c91-4298-a75e-bb99491fb943): created successfully Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9b4de36-752c-4f9b-a2ec-d0490c02ea28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (3f888700-34b9-4d6f-a70b-388a557b52ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cc4058ba-1d87-403e-84b7-eb4b31f8b43e tempest-GroupSnapshotsTest-1885794825 None] Created volume successfully. Aug 03 08:57:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] GroupSnapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: creating. Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Group snapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: creating. {{(pid=88796) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Creating offline snapshot 1e086c43-68ad-4f50-85a6-53228c5c4ccf of volume ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33715fa-64f9-48a1-9772-0fb34586d4f2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:04 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:04 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:04 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.655s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:04 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf 1G Aug 03 08:57:04 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:05 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf 1G" returned: 0 in 0.758s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef54663c-4c91-4298-a75e-bb99491fb943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:05 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef54663c-4c91-4298-a75e-bb99491fb943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:05 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:05 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef54663c-4c91-4298-a75e-bb99491fb943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.503s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:05 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:57:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:05 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:05 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:06 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:06 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info Aug 03 08:57:06 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:06 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info" returned: 0 in 0.498s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:06 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:57:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:06 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info Aug 03 08:57:06 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:07 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.info" returned: 0 in 0.332s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9f6d7e93-14d9-4e71-8e07-e80d8ddd0314 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: created successfully Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (968afb96-e8ac-4c51-8bca-90c57fa4531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29fd912-6442-4599-8358-16cd65e16f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b29fd912-6442-4599-8358-16cd65e16f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1518350854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d771f8-75de-4adc-b09a-87e1c44a99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:08Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be36985c-113c-4a70-ba1d-9d9374cedecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be36985c-113c-4a70-ba1d-9d9374cedecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1614c9-0ee0-4f53-9c8c-0d13af12322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:08 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:08 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1614c9-0ee0-4f53-9c8c-0d13af12322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'volume_name': 'volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d97de7-7a76-47ed-95ef-4801b8ad4897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55d97de7-7a76-47ed-95ef-4801b8ad4897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509cd1f3-59af-4251-a63c-ef8975ecad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:08 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Volume e8d771f8-75de-4adc-b09a-87e1c44a99fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 08:57:08 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Trying to clone e8d771f8-75de-4adc-b09a-87e1c44a99fb from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 08:57:09 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.593s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf-81f41df8-8573-404b-a250-ec08ad18d155" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf-81f41df8-8573-404b-a250-ec08ad18d155" acquired by "_create_volume_from_snapshot" :: waited 0.068s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Creating volume 81f41df8-8573-404b-a250-ec08ad18d155 from snapshot 1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] snapshot: 1e086c43-68ad-4f50-85a6-53228c5c4ccf, volume: 81f41df8-8573-404b-a250-ec08ad18d155, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[91146011-ad7b-4c6c-839c-6b41f64f0bfc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 08:57:09 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Image download 20.69 MB at 20.69 MB/s Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8155044-35af-440c-9442-ef1dd105e871]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:09 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:09 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:10 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD Aug 03 08:57:10 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:10 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.553s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef54663c-4c91-4298-a75e-bb99491fb943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d82d10-77c7-4705-93f8-3416f2d3335d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:10 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD" returned: 0 in 0.473s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user f4ab063fdab94c27b46351681f8e755c. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[535885ed-a11a-4d8e-9577-cc1c4d070189]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:10 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:10 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:10 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD Aug 03 08:57:10 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:10 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:10 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.646s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:57:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:10 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 Aug 03 08:57:10 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:16 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155" returned: 0 in 5.712s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:16 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:57:16 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Converted 1024.00 MB image at 179.22 MB/s Aug 03 08:57:16 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:57:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:16 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 Aug 03 08:57:16 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:16 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155" returned: 0 in 0.313s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" released by "_copy_volume_from_snapshot" :: held 7.402s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf-81f41df8-8573-404b-a250-ec08ad18d155" released by "_create_volume_from_snapshot" :: held 7.536s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.605s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.122s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1518350854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d771f8-75de-4adc-b09a-87e1c44a99fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:08Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Creating volume e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:17 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:17 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1073741824 Aug 03 08:57:17 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6b795132-e730-44ac-8a8f-f1cab4e32bf8 tempest-GroupSnapshotsTest-1885794825 None] Create group from source-snapshot-cc67dbc0-f15f-4996-adf3-46d2de92af65 completed successfully. Aug 03 08:57:17 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1073741824" returned: 0 in 0.772s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:17 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:17 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:18 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.469s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume e8d771f8-75de-4adc-b09a-87e1c44a99fb. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4117b2-2972-42c2-a025-3512016bc9cc]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cfe246-54b1-475f-8a04-fe03ff74f1be]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:18 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx Aug 03 08:57:18 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:18 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 Aug 03 08:57:18 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:19 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx" returned: 0 in 0.591s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:19 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx Aug 03 08:57:19 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:19 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155" returned: 0 in 0.709s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:19 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155 Aug 03 08:57:19 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:19 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx" returned: 1 in 0.479s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7fnyq1hx' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[079186cb-a9fb-4e3a-a0af-4ec49a9f5908]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:19 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81f41df8-8573-404b-a250-ec08ad18d155" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:19 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD Aug 03 08:57:19 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-81f41df8-8573-404b-a250-ec08ad18d155" released by "delete_volume" :: held 1.155s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['7147dcbc-b03f-43b7-b226-398cfddb2e6f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:19 devstack cinder-volume[88796]: WARNING cinder.quota [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-774261440 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-774261440, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:57:19 devstack cinder-volume[88796]: WARNING cinder.quota [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-774261440 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-774261440, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:57:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['565b577c-ac3c-4351-97f5-8f6eefc66c4d', '12ddf02e-b3fe-4c2c-8f3f-a7c26e458c00', '7d05b72e-6078-4414-9a8a-852254572a04', '1f58e191-54ef-4e1f-829d-0404d42d9035'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:20 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD" returned: 0 in 0.652s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:20 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:20 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:20 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:20 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:20 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.480s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0247297b-d4e9-4e8b-8d97-b1869003f013 tempest-GroupSnapshotsTest-1885794825 None] Delete group completed successfully. Aug 03 08:57:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: deleting Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: deleting {{(pid=88796) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Deleting offline snapshot 1e086c43-68ad-4f50-85a6-53228c5c4ccf of volume ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] snapshot_file for this snap is: volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b038af2e-f8e3-4227-8a5d-a6c87d765a5e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:21 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:21 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:22 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.663s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef54663c-4c91-4298-a75e-bb99491fb943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7defb355-257a-44b8-b8d0-3bc175381a10]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:22 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:22 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:23 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.756s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:23 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:23 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:23 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 2.847s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_pp_qu5qndevstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:57:23 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Converted 112.00 MB image at 39.30 MB/s Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:23 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1G Aug 03 08:57:23 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:23 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb 1G" returned: 0 in 0.683s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume e8d771f8-75de-4adc-b09a-87e1c44a99fb successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user f4ab063fdab94c27b46351681f8e755c is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Marking volume e8d771f8-75de-4adc-b09a-87e1c44a99fb as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to e8d771f8-75de-4adc-b09a-87e1c44a99fb. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Creating volume glance metadata for volume e8d771f8-75de-4adc-b09a-87e1c44a99fb backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 08:57:23 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.858s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:23 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf Aug 03 08:57:23 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (509cd1f3-59af-4251-a63c-ef8975ecad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b947ad0-f4f4-4549-b759-e82966e3e31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Volume volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb (e8d771f8-75de-4adc-b09a-87e1c44a99fb): created successfully Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b947ad0-f4f4-4549-b759-e82966e3e31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (968afb96-e8ac-4c51-8bca-90c57fa4531c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-67fbab59-e8c9-4d27-aa66-0e8a4377fa46 tempest-VolumesCloneTest-722982140 None] Created volume successfully. Aug 03 08:57:24 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943.1e086c43-68ad-4f50-85a6-53228c5c4ccf" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-1e086c43-68ad-4f50-85a6-53228c5c4ccf" released by "_delete_snapshot" :: held 3.026s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" released by "delete_snapshot" :: held 3.082s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:24 devstack cinder-volume[88796]: WARNING cinder.quota [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-774261440 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-774261440, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:57:24 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['feee5a03-6d1d-45f5-8235-cb69b5ec9fe2', '01ceed94-199c-4ab5-97cf-63c75eb525c0', 'ec0244b0-ff1e-49a0-b17f-41d1b5a49eac', '91156a41-2c03-4cc9-b378-9987cf7de9d1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-be346de1-9e5f-48a5-aecc-2d6174db3213 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot cc67dbc0-f15f-4996-adf3-46d2de92af65: deleted successfully Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (0dfdb327-e784-40ec-8a5d-5dde78be63c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76302c3a-6637-480c-8dce-3fc01441b4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76302c3a-6637-480c-8dce-3fc01441b4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2020063895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ee66f57-b9f0-4466-876a-36b658566056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e8d771f8-75de-4adc-b09a-87e1c44a99fb,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:25Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdd9471-2b11-4ed7-9f01-84ec0add442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdd9471-2b11-4ed7-9f01-84ec0add442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0b30c-fcb8-4632-aa51-829ab9da5401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb86696-3367-458c-9f30-c696f2d2945b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a0b30c-fcb8-4632-aa51-829ab9da5401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4ee66f57-b9f0-4466-876a-36b658566056', 'volume_name': 'volume-4ee66f57-b9f0-4466-876a-36b658566056', 'volume_size': 1, 'source_volid': 'e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdcf449-0e60-4557-8d4b-2d7f125d5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bdcf449-0e60-4557-8d4b-2d7f125d5f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f67633-ec2d-4348-ad6f-3edc23a2ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Volume 4ee66f57-b9f0-4466-876a-36b658566056: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4ee66f57-b9f0-4466-876a-36b658566056', 'volume_size': 1, 'source_volid': 'e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'source_volstatus': 'available'} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Cloning volume e8d771f8-75de-4adc-b09a-87e1c44a99fb to volume 4ee66f57-b9f0-4466-876a-36b658566056 Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Creating offline snapshot ad7ceb1e-695d-4598-9b59-e045f3edd5ac of volume e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a40f01-f388-4f46-8c07-85c2f0e41e90]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:25 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:25 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:26 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:26 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:26 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.852s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:26 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943 Aug 03 08:57:26 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:26 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.792s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:26 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac 1G Aug 03 08:57:26 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:27 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef54663c-4c91-4298-a75e-bb99491fb943" returned: 0 in 0.790s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ef54663c-4c91-4298-a75e-bb99491fb943" released by "delete_volume" :: held 1.780s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['4a165f78-c4a8-4555-b8be-de9fa7419899'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:27 devstack cinder-volume[88796]: WARNING cinder.db.api [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-774261440'] Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['20aa4d7a-c618-4db1-aa7c-64f9ee3ad923', '72f1310f-9ac7-4142-b92e-77a816db3793', 'df2ac5be-dfad-4c71-9308-7043ad13a740', '1e2f18f9-ccf9-44d2-add1-85c8e6816a46'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:27 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac 1G" returned: 0 in 1.173s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:27 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:27 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:27 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:28 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:28 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.562s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:28 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-38ad3ddb-487d-4324-b022-d015b03e6c99 tempest-GroupSnapshotsTest-1885794825 None] Delete group completed successfully. Aug 03 08:57:28 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.822s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac is being set with open permissions: ugo+rw Aug 03 08:57:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:28 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:28 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:29 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.454s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:29 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info Aug 03 08:57:29 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-43269985-c54f-45cb-b220-8d5ca1be027d tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-2073788029: creating Aug 03 08:57:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-43269985-c54f-45cb-b220-8d5ca1be027d tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-2073788029: created successfully Aug 03 08:57:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-43269985-c54f-45cb-b220-8d5ca1be027d tempest-GroupSnapshotsTest-1885794825 None] Create group completed successfully. Aug 03 08:57:29 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:29 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info is being set with open permissions: ugo+rw Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:29 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info Aug 03 08:57:29 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:29 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.info" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] snapshot: ad7ceb1e-695d-4598-9b59-e045f3edd5ac, volume: 4ee66f57-b9f0-4466-876a-36b658566056, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dc770f-1505-42fe-84bc-1142b66bf82c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:30 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:30 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:30 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9677296-9853-4deb-98da-95a6b96d58e2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Flow 'volume_create_manager' (2cb5213c-ef54-4652-9e1f-94ffa140c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c114e3-8f56-49e7-ae93-b5cde9c0d35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:30 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:30 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c114e3-8f56-49e7-ae93-b5cde9c0d35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-19948996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac986b90-b2c2-4306-a243-5f8204b5cd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283a0d88edf546c28209e32d11d67236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:31Z,use_quota=True,user_id='61efba9aef9d400da4fdd4870e1f83b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6908ec-921c-49de-bab4-da5965f0201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac6908ec-921c-49de-bab4-da5965f0201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2918ce95-e9f2-4523-880f-c6f201dd44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2918ce95-e9f2-4523-880f-c6f201dd44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac986b90-b2c2-4306-a243-5f8204b5cd9e', 'volume_name': 'volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16529911-703e-4b44-b3fa-bb947a9c4d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16529911-703e-4b44-b3fa-bb947a9c4d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f8372c-6724-44ea-9853-d3b2e9041c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume ac986b90-b2c2-4306-a243-5f8204b5cd9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e', 'volume_size': 1} Aug 03 08:57:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:31 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.817s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:57:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:57:31 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:57:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:31 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 Aug 03 08:57:31 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (8379dd26-8648-44cc-97cf-15156e41c77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996d8b18-f377-435a-a79a-3190c93b1ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Flow 'volume_create_manager' (d5683a86-5f79-4f07-8c76-a7e65774552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657b63d4-11de-460e-a3a8-cd061029c318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657b63d4-11de-460e-a3a8-cd061029c318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-454904403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaec35a6-0dd0-4dee-a124-0fa8f31b6b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283a0d88edf546c28209e32d11d67236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:32Z,use_quota=True,user_id='61efba9aef9d400da4fdd4870e1f83b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e510463-1ff4-4c7a-97e2-8cc7b1818738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e510463-1ff4-4c7a-97e2-8cc7b1818738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f488be-30d8-4bb1-9ac4-f31819b92ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f488be-30d8-4bb1-9ac4-f31819b92ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaec35a6-0dd0-4dee-a124-0fa8f31b6b15', 'volume_name': 'volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4778c-b6eb-44d5-8e89-01b2e7f9031d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed4778c-b6eb-44d5-8e89-01b2e7f9031d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bafb9d4-2b27-47da-8426-185b6d0badf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume eaec35a6-0dd0-4dee-a124-0fa8f31b6b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15', 'volume_size': 1} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996d8b18-f377-435a-a79a-3190c93b1ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865787648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,host='devstack@QuobyteHD#QuobyteHD',id=51547063-0ec1-4b76-b4a5-842fa4057b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:32Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68b4c07c-9091-45b1-9910-ad600717de7a),volume_type_id=68b4c07c-9091-45b1-9910-ad600717de7a)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530b8855-4417-40ad-83e6-ed86e3f9f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530b8855-4417-40ad-83e6-ed86e3f9f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209d266c-a108-47bd-b908-cda1f2d98e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (209d266c-a108-47bd-b908-cda1f2d98e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51547063-0ec1-4b76-b4a5-842fa4057b7e', 'volume_name': 'volume-51547063-0ec1-4b76-b4a5-842fa4057b7e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5d297d-c03c-4e79-8a3a-b03f01efeebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee5d297d-c03c-4e79-8a3a-b03f01efeebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8161c931-b40c-497e-b810-437928a21f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Volume 51547063-0ec1-4b76-b4a5-842fa4057b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51547063-0ec1-4b76-b4a5-842fa4057b7e', 'volume_size': 1} Aug 03 08:57:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:33 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056" returned: 0 in 1.841s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:57:33 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Converted 1024.00 MB image at 556.02 MB/s Aug 03 08:57:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 is being set with open permissions: ugo+rw Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:33 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 Aug 03 08:57:33 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:33 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056" returned: 0 in 0.287s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" released by "_copy_volume_from_snapshot" :: held 3.593s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-ad7ceb1e-695d-4598-9b59-e045f3edd5ac" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-ad7ceb1e-695d-4598-9b59-e045f3edd5ac" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Deleting offline snapshot ad7ceb1e-695d-4598-9b59-e045f3edd5ac of volume e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] snapshot_file for this snap is: volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84fe1a4-8d4a-499e-9417-ff54cdd702b4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:33 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:33 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:34 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.407s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33426c5-d8b0-412f-a980-ca455e4b7877]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:34 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:34 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:34 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.523s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:34 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:34 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:35 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:35 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac Aug 03 08:57:35 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:35 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb.ad7ceb1e-695d-4598-9b59-e045f3edd5ac" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-ad7ceb1e-695d-4598-9b59-e045f3edd5ac" released by "_delete_snapshot" :: held 1.929s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.918s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Marking volume 4ee66f57-b9f0-4466-876a-36b658566056 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.733s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-19948996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac986b90-b2c2-4306-a243-5f8204b5cd9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283a0d88edf546c28209e32d11d67236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:31Z,use_quota=True,user_id='61efba9aef9d400da4fdd4870e1f83b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Creating volume ac986b90-b2c2-4306-a243-5f8204b5cd9e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:35 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Copying metadata from source volume e8d771f8-75de-4adc-b09a-87e1c44a99fb to 4ee66f57-b9f0-4466-876a-36b658566056. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 08:57:35 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e 1073741824 Aug 03 08:57:35 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f67633-ec2d-4348-ad6f-3edc23a2ac75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ee66f57-b9f0-4466-876a-36b658566056', 'volume_size': 1, 'source_volid': 'e8d771f8-75de-4adc-b09a-87e1c44a99fb', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b587c2e-7071-4f1f-99ae-1b220968cdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Volume volume-4ee66f57-b9f0-4466-876a-36b658566056 (4ee66f57-b9f0-4466-876a-36b658566056): created successfully Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b587c2e-7071-4f1f-99ae-1b220968cdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (0dfdb327-e784-40ec-8a5d-5dde78be63c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-51794fd0-63aa-4b31-83c0-34cbf698a41f tempest-VolumesCloneTest-722982140 None] Created volume successfully. Aug 03 08:57:36 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e 1073741824" returned: 0 in 0.692s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:36 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e Aug 03 08:57:36 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:36 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e" returned: 0 in 0.513s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.563s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-454904403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaec35a6-0dd0-4dee-a124-0fa8f31b6b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283a0d88edf546c28209e32d11d67236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:32Z,use_quota=True,user_id='61efba9aef9d400da4fdd4870e1f83b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Creating volume eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:36 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:36 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 1073741824 Aug 03 08:57:36 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81f8372c-6724-44ea-9853-d3b2e9041c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10152e2-18ae-4d18-b87e-04a28e373b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:37 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e (ac986b90-b2c2-4306-a243-5f8204b5cd9e): created successfully Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c10152e2-18ae-4d18-b87e-04a28e373b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Flow 'volume_create_manager' (2cb5213c-ef54-4652-9e1f-94ffa140c51a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-94847d44-83ed-47f4-962e-760f41f17836 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Created volume successfully. Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-4ee66f57-b9f0-4466-876a-36b658566056-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "cinder-4ee66f57-b9f0-4466-876a-36b658566056-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129d4f2-aedf-421d-abb9-dcc8f67fec76]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:37 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 Aug 03 08:57:37 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:37 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 1073741824" returned: 0 in 0.900s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:37 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056" returned: 0 in 0.601s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:37 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056 Aug 03 08:57:37 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:38 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 Aug 03 08:57:38 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:38 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ee66f57-b9f0-4466-876a-36b658566056" returned: 0 in 0.580s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-4ee66f57-b9f0-4466-876a-36b658566056" released by "delete_volume" :: held 1.275s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:38 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" returned: 0 in 0.621s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.166s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,created_at=2026-08-03T06:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865787648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,host='devstack@QuobyteHD#QuobyteHD',id=51547063-0ec1-4b76-b4a5-842fa4057b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:32Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68b4c07c-9091-45b1-9910-ad600717de7a),volume_type_id=68b4c07c-9091-45b1-9910-ad600717de7a)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Creating volume 51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:38 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:38 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e 1073741824 Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bafb9d4-2b27-47da-8426-185b6d0badf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:38 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b848261-b0f0-4796-b796-a2ed0d3b0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:38 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Volume volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 (eaec35a6-0dd0-4dee-a124-0fa8f31b6b15): created successfully Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b848261-b0f0-4796-b796-a2ed0d3b0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Flow 'volume_create_manager' (d5683a86-5f79-4f07-8c76-a7e65774552a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-781f2d80-438d-4ee2-99cf-b163a49de431 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Created volume successfully. Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Created reservations ['8271a6e9-2fc3-4250-8c2b-662302b5ffe3', 'ae0dfa36-068a-4008-877f-2a37e700ce04', '61b6dd32-4bcc-4e1b-9ea6-00036f14ad7b', 'e8f2edfe-c1b5-4bd0-ade7-b8bf5a04cf6f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:39 devstack sudo[103052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:39 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:39 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e 1073741824" returned: 0 in 0.929s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:39 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-e8d771f8-75de-4adc-b09a-87e1c44a99fb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.658s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Deleted volume successfully. Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "cinder-e8d771f8-75de-4adc-b09a-87e1c44a99fb-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d851102-c509-4b29-8077-9ca92041add4 tempest-VolumesCloneTest-722982140 None] Lock "cinder-4ee66f57-b9f0-4466-876a-36b658566056-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:39 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e Aug 03 08:57:39 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-e8d771f8-75de-4adc-b09a-87e1c44a99fb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-e8d771f8-75de-4adc-b09a-87e1c44a99fb" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a9352-2e84-45ef-acc4-7ffdddff4103]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:40 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:40 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:40 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e" returned: 0 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8161c931-b40c-497e-b810-437928a21f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51547063-0ec1-4b76-b4a5-842fa4057b7e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18f789f-c8ee-4f21-b7ee-8e69d0742e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:40 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Volume volume-51547063-0ec1-4b76-b4a5-842fa4057b7e (51547063-0ec1-4b76-b4a5-842fa4057b7e): created successfully Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b18f789f-c8ee-4f21-b7ee-8e69d0742e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (8379dd26-8648-44cc-97cf-15156e41c77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-07cdeb30-30fe-45de-b030-08ea59b1df8c tempest-GroupSnapshotsTest-1885794825 None] Created volume successfully. Aug 03 08:57:40 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.445s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:40 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb Aug 03 08:57:40 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:40 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e8d771f8-75de-4adc-b09a-87e1c44a99fb" returned: 0 in 0.287s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-e8d771f8-75de-4adc-b09a-87e1c44a99fb" released by "delete_volume" :: held 0.819s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Created reservations ['b18e05f0-0b1a-4b77-b23c-6244fc0961ca', '0f7cc6b4-2a4a-4c19-99ed-159373dc8ab5', '68ec3a2c-d1ad-4ad7-9f0c-d553447967e7', 'ee5fafed-dca3-4e33-99e4-ffb1916380ba'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:40 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:40 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:41 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.440s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:41 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:57:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Deleted volume successfully. Aug 03 08:57:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5542999-cebc-4a5e-afb5-e12f88917c15 tempest-VolumesCloneTest-722982140 None] Lock "cinder-e8d771f8-75de-4adc-b09a-87e1c44a99fb-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (97de7dc2-a151-4b65-9f89-cd60fd8861a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4e6f2d-a72e-4ebf-9381-732219424cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e4e6f2d-a72e-4ebf-9381-732219424cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-67153067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8282da2b-f028-40cd-ab63-718c96b6afc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:42Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9a87bc-53c5-404c-8313-13bc04b57cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9a87bc-53c5-404c-8313-13bc04b57cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf02b4d-2eda-4e29-b15f-6155a12907df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf02b4d-2eda-4e29-b15f-6155a12907df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8282da2b-f028-40cd-ab63-718c96b6afc2', 'volume_name': 'volume-8282da2b-f028-40cd-ab63-718c96b6afc2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5dbb4-c3a3-46d5-8390-403937cd5c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4f5dbb4-c3a3-46d5-8390-403937cd5c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0217f-5f14-4ba0-9920-af16406ac6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Volume 8282da2b-f028-40cd-ab63-718c96b6afc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8282da2b-f028-40cd-ab63-718c96b6afc2', 'volume_size': 1} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-67153067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8282da2b-f028-40cd-ab63-718c96b6afc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:42Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Creating volume 8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:42 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:42 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 1073741824 Aug 03 08:57:42 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (d92e867c-1f89-4c30-b653-2748472f0f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ea54c-2d7e-4361-9e0f-1345294d1689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1ea54c-2d7e-4361-9e0f-1345294d1689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764009088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,host='devstack@QuobyteHD#QuobyteHD',id=ed9ddcac-e578-47ce-af28-7aeca6256a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:42Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68b4c07c-9091-45b1-9910-ad600717de7a),volume_type_id=68b4c07c-9091-45b1-9910-ad600717de7a)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ca113c-42d1-4318-b80c-16f1291b727d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08ca113c-42d1-4318-b80c-16f1291b727d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d8ed2d-7a57-473b-ab2e-aa0de41a74e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d8ed2d-7a57-473b-ab2e-aa0de41a74e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed9ddcac-e578-47ce-af28-7aeca6256a3d', 'volume_name': 'volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcf620-d0db-4c06-8863-1f6056158b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bcf620-d0db-4c06-8863-1f6056158b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c44749-c40a-464e-94a6-40d3142a138e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Volume ed9ddcac-e578-47ce-af28-7aeca6256a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d', 'volume_size': 1} Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:42 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 1073741824" returned: 0 in 0.812s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:43 devstack sudo[103157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:57:43 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:43 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.760s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,created_at=2026-08-03T06:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-764009088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fd7d7de-28c0-4b52-9b62-3ce74c0766e1,host='devstack@QuobyteHD#QuobyteHD',id=ed9ddcac-e578-47ce-af28-7aeca6256a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:42Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68b4c07c-9091-45b1-9910-ad600717de7a),volume_type_id=68b4c07c-9091-45b1-9910-ad600717de7a)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Creating volume ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:57:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc0217f-5f14-4ba0-9920-af16406ac6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8282da2b-f028-40cd-ab63-718c96b6afc2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:43 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d 1073741824 Aug 03 08:57:43 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df62b6c-8197-424c-a658-33b61a407a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Volume volume-8282da2b-f028-40cd-ab63-718c96b6afc2 (8282da2b-f028-40cd-ab63-718c96b6afc2): created successfully Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df62b6c-8197-424c-a658-33b61a407a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (97de7dc2-a151-4b65-9f89-cd60fd8861a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-234f0a2d-fff8-4187-a61f-29aca091a324 tempest-VolumesCloneTest-722982140 None] Created volume successfully. Aug 03 08:57:43 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d 1073741824" returned: 0 in 0.501s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:43 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d Aug 03 08:57:43 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:44 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c44749-c40a-464e-94a6-40d3142a138e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3574532b-80e1-4824-a5c3-a6d07c7f05dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Volume volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d (ed9ddcac-e578-47ce-af28-7aeca6256a3d): created successfully Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3574532b-80e1-4824-a5c3-a6d07c7f05dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (d92e867c-1f89-4c30-b653-2748472f0f2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bdd86d43-b375-43c3-a273-990adc8677ef tempest-GroupSnapshotsTest-1885794825 None] Created volume successfully. Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (2307e9e3-81b6-4844-9685-6811f7476476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad52c444-f8fa-4db9-b3f7-357f082d96f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad52c444-f8fa-4db9-b3f7-357f082d96f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1756398268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd6d912-853c-46a2-8631-27defb0c7b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85115c481d524fd4a7b23ee602af786f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8282da2b-f028-40cd-ab63-718c96b6afc2,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:44Z,use_quota=True,user_id='f4ab063fdab94c27b46351681f8e755c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b14413-08d7-4700-96f5-359f05a020b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b14413-08d7-4700-96f5-359f05a020b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a62595-e1c6-4705-a227-51bac81bac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0a62595-e1c6-4705-a227-51bac81bac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bdd6d912-853c-46a2-8631-27defb0c7b15', 'volume_name': 'volume-bdd6d912-853c-46a2-8631-27defb0c7b15', 'volume_size': 2, 'source_volid': '8282da2b-f028-40cd-ab63-718c96b6afc2', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f484790-cda8-47c8-a7a5-911910f27c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f484790-cda8-47c8-a7a5-911910f27c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8af3f56-7224-4caa-a6fd-005ce2184e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Volume bdd6d912-853c-46a2-8631-27defb0c7b15: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bdd6d912-853c-46a2-8631-27defb0c7b15', 'volume_size': 2, 'source_volid': '8282da2b-f028-40cd-ab63-718c96b6afc2', 'source_volstatus': 'available'} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:44 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Cloning volume 8282da2b-f028-40cd-ab63-718c96b6afc2 to volume bdd6d912-853c-46a2-8631-27defb0c7b15 Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Creating offline snapshot 0aec7497-9dff-4e8f-be1f-33ab8dce93e9 of volume 8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c69702e-81c4-463e-9dec-5211119b76f3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:45 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:57:45 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-89bbba06-2fd2-4391-9024-8a638bec3f6a tempest-GroupSnapshotsTest-1885794825 None] Update group completed successfully. Aug 03 08:57:45 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.531s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:45 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 1G Aug 03 08:57:45 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:45 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 1G" returned: 0 in 0.574s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8282da2b-f028-40cd-ab63-718c96b6afc2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:46 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8282da2b-f028-40cd-ab63-718c96b6afc2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:46 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:46 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8282da2b-f028-40cd-ab63-718c96b6afc2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.592s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:46 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 is being set with open permissions: ugo+rw Aug 03 08:57:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:46 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:46 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-72da964f-9d55-4cc7-b7fa-b97b5515c17f tempest-GroupSnapshotsTest-1885794825 None] Update group completed successfully. Aug 03 08:57:47 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.452s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:47 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info Aug 03 08:57:47 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:47 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info" returned: 0 in 0.506s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:47 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info is being set with open permissions: ugo+rw Aug 03 08:57:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:47 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info Aug 03 08:57:47 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ca16acc4-db76-488b-b717-17e312c23f34 tempest-GroupSnapshotsTest-1885794825 None] Update group completed successfully. Aug 03 08:57:48 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.info" returned: 0 in 0.469s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] snapshot: 0aec7497-9dff-4e8f-be1f-33ab8dce93e9, volume: bdd6d912-853c-46a2-8631-27defb0c7b15, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3252301b-f47f-47d3-8a0f-9b5a7100c243]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:48 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:48 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:48 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.524s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8282da2b-f028-40cd-ab63-718c96b6afc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1c23f2-326c-4ecd-b567-0907f4fbc220]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:48 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:57:48 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:49 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:57:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:57:49 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:57:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:49 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 Aug 03 08:57:49 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-683a778e-2497-41fc-a665-7dbe49b1c183 tempest-GroupSnapshotsTest-1885794825 None] Update group completed successfully. Aug 03 08:57:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] GroupSnapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: creating. Aug 03 08:57:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Group snapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: creating. {{(pid=88796) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:57:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (d2dea908-c043-433b-9b4e-7f116f84942c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e47b8f-2306-4db9-961a-acc5db61b843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e47b8f-2306-4db9-961a-acc5db61b843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1733508423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036d96e-5fb9-4bb4-a28c-6a568020f148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fc3db0c2dd4854abf3ff8c5209539f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:54Z,use_quota=True,user_id='506b16bfcf73496ea538e869170e1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b16755-07da-43e0-b7df-ed19002a5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48b16755-07da-43e0-b7df-ed19002a5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cca2200-bd20-406f-8135-d209727f7887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cca2200-bd20-406f-8135-d209727f7887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7036d96e-5fb9-4bb4-a28c-6a568020f148', 'volume_name': 'volume-7036d96e-5fb9-4bb4-a28c-6a568020f148', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21c6034-eae1-4fc3-a735-5f5c43f0cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e21c6034-eae1-4fc3-a735-5f5c43f0cc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c185b6b9-48ad-4f00-b11e-e91780939f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Volume 7036d96e-5fb9-4bb4-a28c-6a568020f148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7036d96e-5fb9-4bb4-a28c-6a568020f148', 'volume_size': 1} Aug 03 08:57:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:55 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15" returned: 0 in 6.197s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:57:55 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Converted 1024.00 MB image at 165.21 MB/s Aug 03 08:57:55 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 is being set with open permissions: ugo+rw Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:55 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 Aug 03 08:57:55 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:55 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15" returned: 0 in 0.259s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" released by "_copy_volume_from_snapshot" :: held 7.503s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-0aec7497-9dff-4e8f-be1f-33ab8dce93e9" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-0aec7497-9dff-4e8f-be1f-33ab8dce93e9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Deleting offline snapshot 0aec7497-9dff-4e8f-be1f-33ab8dce93e9 of volume 8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] snapshot_file for this snap is: volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1bfac5-3f32-4a35-8d91-94f6dd9b6fbb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:55 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:55 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:56 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8282da2b-f028-40cd-ab63-718c96b6afc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3950d60-0f04-46c5-b480-908e0983b1b4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:56 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:57:56 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:56 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.557s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:56 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:56 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:57 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:57 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9 Aug 03 08:57:57 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:57 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2.0aec7497-9dff-4e8f-be1f-33ab8dce93e9" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-0aec7497-9dff-4e8f-be1f-33ab8dce93e9" released by "_delete_snapshot" :: held 1.713s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=92,cinder:UPDATE=80,cinder:INSERT=31,cinder:DELETE=4 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=88,cinder:SELECT=88,cinder:DELETE=6,cinder:INSERT=31 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.659s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.954s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Creating offline snapshot 188cab37-92b9-4b5b-ba38-5d530693e6c8 of volume 51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8af3f56-7224-4caa-a6fd-005ce2184e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd6d912-853c-46a2-8631-27defb0c7b15', 'volume_size': 2, 'source_volid': '8282da2b-f028-40cd-ab63-718c96b6afc2', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82911295-3675-4756-8e97-8a39afc4321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08fbec5-e507-4ba4-a837-90ad6568ad59]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:57 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Volume volume-bdd6d912-853c-46a2-8631-27defb0c7b15 (bdd6d912-853c-46a2-8631-27defb0c7b15): created successfully Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82911295-3675-4756-8e97-8a39afc4321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Flow 'volume_create_manager' (2307e9e3-81b6-4844-9685-6811f7476476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:57:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ffee6087-211b-4667-bfe6-43b9daca526c tempest-VolumesCloneTest-722982140 None] Created volume successfully. Aug 03 08:57:57 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e Aug 03 08:57:57 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:57 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e" returned: 0 in 0.430s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:57 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 1G Aug 03 08:57:57 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:58 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 1G" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51547063-0ec1-4b76-b4a5-842fa4057b7e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:58 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51547063-0ec1-4b76-b4a5-842fa4057b7e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 Aug 03 08:57:58 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-bdd6d912-853c-46a2-8631-27defb0c7b15-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "cinder-bdd6d912-853c-46a2-8631-27defb0c7b15-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8d3151-3dd7-4fea-9427-7742acdbb9a3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:58 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51547063-0ec1-4b76-b4a5-842fa4057b7e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:58 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:57:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:58 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 Aug 03 08:57:58 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:58 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 Aug 03 08:57:58 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:59 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:59 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info Aug 03 08:57:59 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:59 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15" returned: 0 in 0.549s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:59 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15 Aug 03 08:57:59 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:59 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:59 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:59 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info Aug 03 08:57:59 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bdd6d912-853c-46a2-8631-27defb0c7b15" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-bdd6d912-853c-46a2-8631-27defb0c7b15" released by "delete_volume" :: held 0.926s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Created reservations ['b1f29eee-7683-4afe-9197-43f3a676d6d3', 'fe5288e5-19a4-49b3-b0a9-b799e79a440c', '50c95933-39b4-40cb-94e2-ac03c015e33c', '07baf95c-8d48-4da3-86ab-d682bb96e713'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:59 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:57:59 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:57:59 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.info" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Creating offline snapshot fa3c52f4-35fd-4629-964e-70ec9e2f4051 of volume ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-8282da2b-f028-40cd-ab63-718c96b6afc2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf98cc-ca01-4cf0-8960-a2c135d15aa0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "cinder-8282da2b-f028-40cd-ab63-718c96b6afc2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Acquiring lock "cinder-quobyte-8282da2b-f028-40cd-ab63-718c96b6afc2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-8282da2b-f028-40cd-ab63-718c96b6afc2" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:57:59 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Aug 03 08:57:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73fdcbd-407d-4b05-bb66-5f8435b5d4a6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:00 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d Aug 03 08:58:00 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Deleted volume successfully. Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e306fa9c-8980-4e1c-9081-b75806d76548 tempest-VolumesCloneTest-722982140 None] Lock "cinder-bdd6d912-853c-46a2-8631-27defb0c7b15-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:00 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:58:00 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:00 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d" returned: 0 in 0.470s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:00 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 1G Aug 03 08:58:00 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:00 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.442s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:00 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2 Aug 03 08:58:00 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:00 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8282da2b-f028-40cd-ab63-718c96b6afc2" returned: 0 in 0.308s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:00 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "cinder-quobyte-8282da2b-f028-40cd-ab63-718c96b6afc2" released by "delete_volume" :: held 0.838s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 1G" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:00 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 Aug 03 08:58:00 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Created reservations ['08de438f-15ab-4e7c-a705-07cdd63f17ca', '5f3e4c48-d926-4bb9-bc51-c2d614902ef4', '965c33ef-c3aa-46c5-a0df-91ff2d1ad84e', '7a4cb282-a966-4bd8-a631-e879818dd618'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:00 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:00 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:01 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051" returned: 0 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:01 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 Aug 03 08:58:01 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:01 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Deleted volume successfully. Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1a4b8411-a894-4aaa-ac94-f9dce24c31d1 tempest-VolumesCloneTest-722982140 None] Lock "cinder-8282da2b-f028-40cd-ab63-718c96b6afc2-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:01 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051" returned: 0 in 0.317s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:01 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info Aug 03 08:58:01 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:01 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:01 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:58:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:01 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info Aug 03 08:58:01 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:02 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.info" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.126s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1733508423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036d96e-5fb9-4bb4-a28c-6a568020f148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fc3db0c2dd4854abf3ff8c5209539f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:57:54Z,use_quota=True,user_id='506b16bfcf73496ea538e869170e1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Creating volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:02 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:02 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 1073741824 Aug 03 08:58:02 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7f8f84e0-9bd1-4d74-8950-c603b1d29095 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: created successfully Aug 03 08:58:02 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 1073741824" returned: 0 in 0.634s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:02 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 08:58:02 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:03 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.270s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c185b6b9-48ad-4f00-b11e-e91780939f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7036d96e-5fb9-4bb4-a28c-6a568020f148', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0334ea7-c9f2-40dd-a211-b991f81a8cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Volume volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 (7036d96e-5fb9-4bb4-a28c-6a568020f148): created successfully Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0334ea7-c9f2-40dd-a211-b991f81a8cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (d2dea908-c043-433b-9b4e-7f116f84942c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2020f41e-d55e-445f-b1ed-2cfe41cba71a tempest-SnapshotDataIntegrityTests-1209494324 None] Created volume successfully. Aug 03 08:58:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: deleting Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: deleting {{(pid=88796) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-188cab37-92b9-4b5b-ba38-5d530693e6c8" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-188cab37-92b9-4b5b-ba38-5d530693e6c8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Deleting offline snapshot 188cab37-92b9-4b5b-ba38-5d530693e6c8 of volume 51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] snapshot_file for this snap is: volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[64652f99-a1df-4c0f-b53e-7a27d93b36ce]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:03 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 Aug 03 08:58:03 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:04 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51547063-0ec1-4b76-b4a5-842fa4057b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46ea78-023d-4e66-9642-2b37c884577b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:04 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e Aug 03 08:58:04 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:04 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:04 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 Aug 03 08:58:04 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8feb469e-47ed-42f4-9236-cc013f2c46cc req-e2c82539-22cf-4c2e-9b13-8e2c4c06335a tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8feb469e-47ed-42f4-9236-cc013f2c46cc req-e2c82539-22cf-4c2e-9b13-8e2c4c06335a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-8feb469e-47ed-42f4-9236-cc013f2c46cc req-e2c82539-22cf-4c2e-9b13-8e2c4c06335a tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-8feb469e-47ed-42f4-9236-cc013f2c46cc req-e2c82539-22cf-4c2e-9b13-8e2c4c06335a tempest-SnapshotDataIntegrityTests-1209494324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-7036d96e-5fb9-4bb4-a28c-6a568020f148', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ea78385-c072-4579-9372-272c746d4743', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:58:05 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8" returned: 0 in 0.489s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:05 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8 Aug 03 08:58:05 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-8feb469e-47ed-42f4-9236-cc013f2c46cc req-e2c82539-22cf-4c2e-9b13-8e2c4c06335a tempest-SnapshotDataIntegrityTests-1209494324 None] attachment_update completed successfully. Aug 03 08:58:05 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e.188cab37-92b9-4b5b-ba38-5d530693e6c8" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-188cab37-92b9-4b5b-ba38-5d530693e6c8" released by "_delete_snapshot" :: held 1.911s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" released by "delete_snapshot" :: held 1.946s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-fa3c52f4-35fd-4629-964e-70ec9e2f4051" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-fa3c52f4-35fd-4629-964e-70ec9e2f4051" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Deleting offline snapshot fa3c52f4-35fd-4629-964e-70ec9e2f4051 of volume ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] snapshot_file for this snap is: volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0361a82d-02ff-4615-b1c5-6f8fe1c70665]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:05 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 Aug 03 08:58:05 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:06 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae42576a-e216-408c-99d3-94f45d03cd23]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:06 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d Aug 03 08:58:06 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:06 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d" returned: 0 in 0.556s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:06 devstack sudo[103812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 Aug 03 08:58:06 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:07 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051" returned: 0 in 0.497s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:07 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051 Aug 03 08:58:07 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:07 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d.fa3c52f4-35fd-4629-964e-70ec9e2f4051" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-fa3c52f4-35fd-4629-964e-70ec9e2f4051" released by "_delete_snapshot" :: held 2.065s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" released by "delete_snapshot" :: held 2.089s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:07 devstack cinder-volume[88796]: WARNING cinder.quota [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1619757043 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1619757043, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:07 devstack cinder-volume[88796]: WARNING cinder.quota [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1619757043 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1619757043, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:07 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['fd477276-c018-4da0-bde6-f4ea7afb6e81', 'a0bb0b61-9bb1-4891-97fe-c13352a9e4d9', '483d883a-515a-4f66-a3f7-fb77b38e9ff7', 'da7e158e-b598-45c4-aa85-4074e7abbfbe'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['695df715-614e-423e-a6dc-f3953dc81aec', 'c3bfacdf-35c7-431d-9233-ff4f7d9143d0', '1c923f95-2c44-4a23-ba3c-8cc54afe77b7', 'f979dbfa-4d1a-4688-b3bf-20e814e5f7d5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ce96eefb-4437-4e72-8fcb-5967c6cd1ec4 tempest-GroupSnapshotsTest-1885794825 None] group_snapshot f7ac42e0-e01f-440f-9ffd-59c867f361ad: deleted successfully Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (9a612d60-3452-460a-837f-8967ed94a93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08a82a6-3ca8-4208-a4f6-099e9527defb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08a82a6-3ca8-4208-a4f6-099e9527defb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922832223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975b088e-9afe-48b4-ab28-c6201e729f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:09Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0587d607-6724-4f47-b18f-6f62eb7879a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0587d607-6724-4f47-b18f-6f62eb7879a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79464b83-711f-4f46-9916-62c144ffebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79464b83-711f-4f46-9916-62c144ffebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '975b088e-9afe-48b4-ab28-c6201e729f23', 'volume_name': 'volume-975b088e-9afe-48b4-ab28-c6201e729f23', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack sudo[103849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:08 devstack sudo[103849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef19b6-245b-403b-b2f5-519675279260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef19b6-245b-403b-b2f5-519675279260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713dab20-0dd9-4e6d-addc-57bc34e53c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:08 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Volume 975b088e-9afe-48b4-ab28-c6201e729f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-975b088e-9afe-48b4-ab28-c6201e729f23', 'volume_size': 1} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-922832223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=975b088e-9afe-48b4-ab28-c6201e729f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:09Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Creating volume 975b088e-9afe-48b4-ab28-c6201e729f23 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:08 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:08 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 1073741824 Aug 03 08:58:08 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc5afb3-e4ea-4df3-8d0e-9e72ef45c652]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[103849]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:58:09 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e Aug 03 08:58:09 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 1073741824" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 Aug 03 08:58:09 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e Aug 03 08:58:09 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.785s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713dab20-0dd9-4e6d-addc-57bc34e53c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-975b088e-9afe-48b4-ab28-c6201e729f23', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86e5fa-aeb0-4b37-af89-a53f36cff22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:09 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating online snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:58:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Volume volume-975b088e-9afe-48b4-ab28-c6201e729f23 (975b088e-9afe-48b4-ab28-c6201e729f23): created successfully Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f86e5fa-aeb0-4b37-af89-a53f36cff22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (9a612d60-3452-460a-837f-8967ed94a93b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f821e-482d-4a01-95b2-49b1412fd1d9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51547063-0ec1-4b76-b4a5-842fa4057b7e" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-51547063-0ec1-4b76-b4a5-842fa4057b7e" released by "delete_volume" :: held 0.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bfd81a08-1da2-4680-a2d8-025f3f25d2ac tempest-VolumesListTestJSON-2028338186 None] Created volume successfully. Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b30499f-5159-443f-8e11-4c3ef27948c3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:09 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 08:58:09 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:09 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d Aug 03 08:58:09 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:10 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 1G Aug 03 08:58:10 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d" returned: 0 in 0.431s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:10 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d Aug 03 08:58:10 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ed9ddcac-e578-47ce-af28-7aeca6256a3d" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-ed9ddcac-e578-47ce-af28-7aeca6256a3d" released by "delete_volume" :: held 0.810s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['5a1b934b-53ce-4604-86c4-2f5c73a1ef1a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:10 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 1G" returned: 0 in 0.597s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:10 devstack cinder-volume[88796]: WARNING cinder.quota [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1619757043 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1619757043, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:10 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 08:58:10 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['3f0fccc2-1d6c-42c9-ba2e-e231c6996c45', '9dfec207-abe1-40bf-869b-ac0b026cadfa', 'ce56baf8-2c67-4b97-8c1c-5f4192cbad61', '44cfc577-5abb-4ccf-ad17-cee6ff9da355'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['a421dae5-eeb8-4411-99b1-a98a2c5d6581', '7efab53e-e6d3-46b6-9c13-6a36389d3edb', 'f179c74f-fd19-4234-8ca4-46a64990f370', 'fc32de50-fdc3-426d-ae9c-1e3a56f9a69c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:11 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:11 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 is being set with open permissions: ugo+rw Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:11 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 08:58:11 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:11 devstack sudo[103901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:11 devstack sudo[103901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (7181a601-7168-4467-bba9-8895bbf9d2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:11 devstack sudo[103901]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4602aed3-2220-4844-9bd0-24ae2b1eff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:11 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4602aed3-2220-4844-9bd0-24ae2b1eff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054787031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e6480-cf21-419b-9f89-846a856c0819,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:11Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2001df4-0131-4805-9595-4be6c9dae18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2001df4-0131-4805-9595-4be6c9dae18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8230a2-82f4-40d3-8468-2cf148f081a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d8230a2-82f4-40d3-8468-2cf148f081a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2e6480-cf21-419b-9f89-846a856c0819', 'volume_name': 'volume-2f2e6480-cf21-419b-9f89-846a856c0819', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ca9c3b-e168-44fc-a2b2-820cb59a5beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ca9c3b-e168-44fc-a2b2-820cb59a5beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639a1ee-9d7c-46d8-914f-0431d0f2e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Volume 2f2e6480-cf21-419b-9f89-846a856c0819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2e6480-cf21-419b-9f89-846a856c0819', 'volume_size': 1} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:58:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1674f049-e714-4287-be8d-8dd902a39421 tempest-GroupSnapshotsTest-1885794825 None] Delete group completed successfully. Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-466afe90-bb9d-4f32-b485-c5ec349ce417 req-f1cc8c8d-ac9a-49ab-a8fa-c1dd4893285f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f3fe846f-eecf-4254-a584-909d66bd31cc tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-1308667020: creating Aug 03 08:58:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f3fe846f-eecf-4254-a584-909d66bd31cc tempest-GroupSnapshotsTest-1885794825 None] Group tempest-GroupSnapshotsTest-Group-1308667020: created successfully Aug 03 08:58:11 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a693a71316c21dd12328bd2adc1b0869ac22d14f6abff4f70b5377e35a6e8f0d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f60bb110-0cef-433c-9951-cb56b8425b68" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "7036d96e-5fb9-4bb4-a28c-6a568020f148", "create_info": {"type": "qcow2", "new_file": "volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41", "snapshot_id": "7bc70f25-b173-49b5-ac02-9c82b7085f41"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:58:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f3fe846f-eecf-4254-a584-909d66bd31cc tempest-GroupSnapshotsTest-1885794825 None] Create group completed successfully. Aug 03 08:58:12 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:58:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f272c098-8c04-4708-aa3c-a932ab9cc170 x-openstack-request-id: req-f272c098-8c04-4708-aa3c-a932ab9cc170 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:58:12 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "7036d96e-5fb9-4bb4-a28c-6a568020f148"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:58:12 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-f272c098-8c04-4708-aa3c-a932ab9cc170 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:58:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:58:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (85cc3fdb-de98-42c0-86b1-5d82e070e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1b7785-2d02-47cb-9bbf-0561a74a506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1b7785-2d02-47cb-9bbf-0561a74a506c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264003802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35392203-204d-4ea8-beb7-800b86721976,host='devstack@QuobyteHD#QuobyteHD',id=59c81baf-419c-446d-8024-dbd32d1b0bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:14Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94530259-056f-45a2-ac85-39e9b42be3fe),volume_type_id=94530259-056f-45a2-ac85-39e9b42be3fe)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e3929d-28e4-4835-8bf3-c4eac6437cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e3929d-28e4-4835-8bf3-c4eac6437cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fde9bed-38e0-4321-bee7-326f86fbcde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fde9bed-38e0-4321-bee7-326f86fbcde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c81baf-419c-446d-8024-dbd32d1b0bdc', 'volume_name': 'volume-59c81baf-419c-446d-8024-dbd32d1b0bdc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a449fc-75f6-4ba3-8b2f-174ab1b6ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a449fc-75f6-4ba3-8b2f-174ab1b6ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea685a55-5768-4813-83ad-042503e1c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Volume 59c81baf-419c-446d-8024-dbd32d1b0bdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c81baf-419c-446d-8024-dbd32d1b0bdc', 'volume_size': 1} Aug 03 08:58:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:29 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info Aug 03 08:58:29 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:29 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:29 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info is being set with open permissions: ugo+rw Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:29 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info Aug 03 08:58:29 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:29 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.info" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 20.230s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.199s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2054787031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2e6480-cf21-419b-9f89-846a856c0819,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:11Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Creating volume 2f2e6480-cf21-419b-9f89-846a856c0819 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:58:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:29 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 1073741824 Aug 03 08:58:29 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f60bb110-0cef-433c-9951-cb56b8425b68 tempest-SnapshotDataIntegrityTests-1209494324 None] Create snapshot completed successfully Aug 03 08:58:30 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 1073741824" returned: 0 in 0.545s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:30 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 Aug 03 08:58:30 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:30 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-466afe90-bb9d-4f32-b485-c5ec349ce417 req-f1cc8c8d-ac9a-49ab-a8fa-c1dd4893285f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.989s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-466afe90-bb9d-4f32-b485-c5ec349ce417 req-f1cc8c8d-ac9a-49ab-a8fa-c1dd4893285f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.164s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=35392203-204d-4ea8-beb7-800b86721976,created_at=2026-08-03T06:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-264003802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=35392203-204d-4ea8-beb7-800b86721976,host='devstack@QuobyteHD#QuobyteHD',id=59c81baf-419c-446d-8024-dbd32d1b0bdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b0f91d4d9a4bd8bfa1a8b10d15575e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:14Z,use_quota=True,user_id='d077c540dbe2405a8a69ca648bcfe782',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94530259-056f-45a2-ac85-39e9b42be3fe),volume_type_id=94530259-056f-45a2-ac85-39e9b42be3fe)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Creating volume 59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639a1ee-9d7c-46d8-914f-0431d0f2e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2e6480-cf21-419b-9f89-846a856c0819', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:30 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc 1073741824 Aug 03 08:58:30 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc69ea0-9521-42f1-95eb-5ed5f1886aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Volume volume-2f2e6480-cf21-419b-9f89-846a856c0819 (2f2e6480-cf21-419b-9f89-846a856c0819): created successfully Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc69ea0-9521-42f1-95eb-5ed5f1886aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (7181a601-7168-4467-bba9-8895bbf9d2c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-466afe90-bb9d-4f32-b485-c5ec349ce417 req-f1cc8c8d-ac9a-49ab-a8fa-c1dd4893285f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2941e6e-07d5-4b4c-bba8-053da0c5b595', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:58:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a440fd9c-3951-4b04-940f-553155052eda tempest-VolumesListTestJSON-2028338186 None] Created volume successfully. Aug 03 08:58:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-466afe90-bb9d-4f32-b485-c5ec349ce417 req-f1cc8c8d-ac9a-49ab-a8fa-c1dd4893285f tempest-TestServerVolumeAttachmentScenario-1794838478 None] attachment_update completed successfully. Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:31 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc 1073741824" returned: 0 in 0.585s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:31 devstack sudo[103993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc Aug 03 08:58:31 devstack sudo[103993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:31 devstack sudo[103993]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc" returned: 0 in 0.400s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.575s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea685a55-5768-4813-83ad-042503e1c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c81baf-419c-446d-8024-dbd32d1b0bdc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2831541-9c48-457e-8073-144c005b49f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating online snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:58:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Volume volume-59c81baf-419c-446d-8024-dbd32d1b0bdc (59c81baf-419c-446d-8024-dbd32d1b0bdc): created successfully Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2831541-9c48-457e-8073-144c005b49f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Flow 'volume_create_manager' (85cc3fdb-de98-42c0-86b1-5d82e070e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d2314-4106-496c-8ddc-4daa360b2f7f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (8aa44816-5d86-48df-84c2-8e5da6892aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a3b34d-8c60-47e3-9128-a61685753fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e0a8774e-e02e-4ca1-8d3c-fd46203eb9fa tempest-GroupSnapshotsTest-1885794825 None] Created volume successfully. Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a3b34d-8c60-47e3-9128-a61685753fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-721928706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21104f5-bf46-4a67-bbb2-5f2ab2d3f340,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:32Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4c2bd-b097-43c8-bb8e-6e2c4747a353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4c2bd-b097-43c8-bb8e-6e2c4747a353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c73108d-c287-4cb3-9cfa-07e98fe557d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c73108d-c287-4cb3-9cfa-07e98fe557d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd21104f5-bf46-4a67-bbb2-5f2ab2d3f340', 'volume_name': 'volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc94d726-2166-4af3-9ec1-5a02d717f285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc94d726-2166-4af3-9ec1-5a02d717f285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b53edc-0e55-463e-97d8-284083c4146d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Volume d21104f5-bf46-4a67-bbb2-5f2ab2d3f340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340', 'volume_size': 1} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:32 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 08:58:32 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:32 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.434s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:32 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 1G Aug 03 08:58:32 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:32 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 1G" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:32 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 08:58:32 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:33 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is being set with open permissions: ugo+rw Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:33 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 08:58:33 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:33 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:58:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] GroupSnapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: creating. Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Group snapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: creating. {{(pid=88796) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b79f16e9571906b2e4227a9ad9147d0a247a7e5500d0da1a5269f781304349ff" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9796b69c-27ef-41bc-972a-86ed331bae89" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "7036d96e-5fb9-4bb4-a28c-6a568020f148", "create_info": {"type": "qcow2", "new_file": "volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554", "snapshot_id": "6ad4bc5d-72fe-4e57-a4b5-518f9711e554"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:58:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61bc1b9e-8f15-4a95-a744-ed75c22d94d9 x-openstack-request-id: req-61bc1b9e-8f15-4a95-a744-ed75c22d94d9 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "7036d96e-5fb9-4bb4-a28c-6a568020f148"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-61bc1b9e-8f15-4a95-a744-ed75c22d94d9 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:58:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-11811baa-69f1-4690-b102-8340e78eebf6 req-e182c968-e713-44a0-83b9-2e0d88618373 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.144s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.876s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-721928706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21104f5-bf46-4a67-bbb2-5f2ab2d3f340,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c3624d716ef54737bff77afa70d672c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:58:32Z,use_quota=True,user_id='852f9b07bc0a484bb760643c6775fd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Creating volume d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:58:51 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:51 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 1073741824 Aug 03 08:58:51 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9796b69c-27ef-41bc-972a-86ed331bae89 tempest-SnapshotDataIntegrityTests-1209494324 None] Create snapshot completed successfully Aug 03 08:58:51 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 1073741824" returned: 0 in 0.491s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:51 devstack sudo[104086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 Aug 03 08:58:51 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:51 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" returned: 0 in 0.249s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.168s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b53edc-0e55-463e-97d8-284083c4146d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce797c-15da-4d77-965b-332846928f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Creating offline snapshot 0a429dfd-1a42-479a-a776-5ff242625daf of volume 59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d7fac-82d3-42e3-a753-ebfe2b295ddf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Volume volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 (d21104f5-bf46-4a67-bbb2-5f2ab2d3f340): created successfully Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ce797c-15da-4d77-965b-332846928f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:58:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Flow 'volume_create_manager' (8aa44816-5d86-48df-84c2-8e5da6892aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:58:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1266b87b-f9a1-4d96-bda1-f60b3525faf4 tempest-VolumesListTestJSON-2028338186 None] Created volume successfully. Aug 03 08:58:51 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc Aug 03 08:58:51 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:52 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:52 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf 1G Aug 03 08:58:52 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:52 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf 1G" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c81baf-419c-446d-8024-dbd32d1b0bdc -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:52 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c81baf-419c-446d-8024-dbd32d1b0bdc -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf Aug 03 08:58:52 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:52 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c81baf-419c-446d-8024-dbd32d1b0bdc -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:52 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:58:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:53 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf Aug 03 08:58:53 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:53 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:53 devstack sudo[104113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info Aug 03 08:58:53 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:53 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:53 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:53 devstack sudo[104116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info Aug 03 08:58:53 devstack sudo[104116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:53 devstack sudo[104116]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.info" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-11811baa-69f1-4690-b102-8340e78eebf6 req-e182c968-e713-44a0-83b9-2e0d88618373 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.748s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-11811baa-69f1-4690-b102-8340e78eebf6 req-e182c968-e713-44a0-83b9-2e0d88618373 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.538s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating online snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-11811baa-69f1-4690-b102-8340e78eebf6 req-e182c968-e713-44a0-83b9-2e0d88618373 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42e8edfc-04c9-47b3-9312-42f66208b557', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a65f9-c1e4-4017-ac57-29e25f548c88]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bbdffc18-1532-42f5-8834-ffaeadaa25df tempest-GroupSnapshotsTest-1885794825 None] group_snapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: created successfully Aug 03 08:58:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-11811baa-69f1-4690-b102-8340e78eebf6 req-e182c968-e713-44a0-83b9-2e0d88618373 tempest-TestServerVolumeAttachmentScenario-1794838478 None] attachment_update completed successfully. Aug 03 08:58:54 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 08:58:54 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:54 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.469s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:54 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 1G Aug 03 08:58:54 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-quobyte-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9784b501-4055-4679-91d7-9ed7ff355543]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:54 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 Aug 03 08:58:54 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] group_snapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: deleting Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] group_snapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: deleting {{(pid=88796) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-0a429dfd-1a42-479a-a776-5ff242625daf" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-0a429dfd-1a42-479a-a776-5ff242625daf" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Deleting offline snapshot 0a429dfd-1a42-479a-a776-5ff242625daf of volume 59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] snapshot_file for this snap is: volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c6ce2-80ab-4c34-9b50-db4d82184221]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340 Aug 03 08:58:55 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 1G" returned: 0 in 0.719s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf Aug 03 08:58:55 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 08:58:55 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf" returned: 0 in 0.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59c81baf-419c-446d-8024-dbd32d1b0bdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340" released by "delete_volume" :: held 1.055s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:55 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 is being set with open permissions: ugo+rw Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc96e7e1-1c2a-4f84-80a4-ff97691d23e3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[104152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 08:58:55 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Created reservations ['8ad6f2f7-e7dc-4e9d-805b-218391616510', '68e14ac9-8d4d-4a03-97c6-275e0dc6ff99', 'e73e4aa3-bcbf-45ee-938c-4851df99eeec', '56559d4f-dfee-4e62-b587-16cc489f92be'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:55 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc Aug 03 08:58:55 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack sudo[104155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:55 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:55 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:55 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}e6e23aeee4126acc8e802818ebab222245e0a05c3ddbe111f64be794f40a782b" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c84b5ce6-82ec-45af-8705-5a198fbb8d25" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "7036d96e-5fb9-4bb4-a28c-6a568020f148", "create_info": {"type": "qcow2", "new_file": "volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341", "snapshot_id": "f57b4d00-a7bd-4226-af9d-d68b0472a341"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 08:58:56 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc" returned: 0 in 0.468s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:56 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Deleted volume successfully. Aug 03 08:58:56 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf Aug 03 08:58:56 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b3dae9cb-f102-40fb-a149-2899faf14cb3 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-d21104f5-bf46-4a67-bbb2-5f2ab2d3f340-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 06:58:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2a8e1b97-8530-4825-af15-e51fd9bd1a55 x-openstack-request-id: req-2a8e1b97-8530-4825-af15-e51fd9bd1a55 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "7036d96e-5fb9-4bb4-a28c-6a568020f148"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-2a8e1b97-8530-4825-af15-e51fd9bd1a55 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:56 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf" returned: 0 in 0.415s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:56 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf Aug 03 08:58:56 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-2f2e6480-cf21-419b-9f89-846a856c0819-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-2f2e6480-cf21-419b-9f89-846a856c0819-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:56 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc.0a429dfd-1a42-479a-a776-5ff242625daf" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-0a429dfd-1a42-479a-a776-5ff242625daf" released by "_delete_snapshot" :: held 1.884s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" released by "delete_snapshot" :: held 1.915s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-quobyte-2f2e6480-cf21-419b-9f89-846a856c0819" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-2f2e6480-cf21-419b-9f89-846a856c0819" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abbff6e-0dee-4325-8b09-429ab20e1b47]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-24564659-0cb0-4bb6-8dd2-14b2a7ea7349 req-93fccba9-7119-43dc-a323-6ad91328bba9 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Terminate volume connection completed successfully. Aug 03 08:58:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-24564659-0cb0-4bb6-8dd2-14b2a7ea7349 req-93fccba9-7119-43dc-a323-6ad91328bba9 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Deleting attachment 42e8edfc-04c9-47b3-9312-42f66208b557. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:58:56 devstack cinder-volume[88796]: WARNING cinder.quota [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2120905632 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2120905632, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:56 devstack cinder-volume[88796]: WARNING cinder.quota [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2120905632 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2120905632, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['27be507a-322a-4172-bf51-df82d8519e35', 'c521b696-de0a-4282-ac17-cc1fbbe8ffb0', 'a23e1cde-399d-4c2e-bb22-ce4343f38cac', '4eee09da-ec39-43a1-95cc-bbf571bb9add'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:57 devstack sudo[104181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 Aug 03 08:58:57 devstack sudo[104181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-faf6879d-1f8f-4f74-ac3e-c69c64939a0f tempest-GroupSnapshotsTest-1885794825 None] group_snapshot b14c06a6-f393-4ab6-b2a0-78f9e1fc9e8d: deleted successfully Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:57 devstack sudo[104181]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:57 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819 Aug 03 08:58:57 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=118,cinder:UPDATE=97,cinder:INSERT=20,cinder:DELETE=7 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=118,cinder:UPDATE=91,cinder:DELETE=4,cinder:INSERT=23 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" acquired by "delete_volume" :: waited 0.056s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:57 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf33f0e-95c1-44bf-a7ba-93f8a207d137]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f2e6480-cf21-419b-9f89-846a856c0819" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-2f2e6480-cf21-419b-9f89-846a856c0819" released by "delete_volume" :: held 0.895s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Created reservations ['33e07ff6-0764-4568-a4f1-114931abec8f', '7c45f01c-2475-4a8f-9018-e1e273418c2a', 'b3351506-7182-4389-8a60-d1b722db2964', '050945d9-9da5-4fb4-91a1-518b2ba42ac6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:57 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc Aug 03 08:58:57 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:58 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:58 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc" returned: 0 in 0.442s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:58 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc Aug 03 08:58:58 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Deleted volume successfully. Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-30142146-117e-45b1-95a4-4ff560e9f0ac tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-2f2e6480-cf21-419b-9f89-846a856c0819-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:58 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-59c81baf-419c-446d-8024-dbd32d1b0bdc" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Lock "cinder-quobyte-59c81baf-419c-446d-8024-dbd32d1b0bdc" released by "delete_volume" :: held 0.798s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['aa905af8-8a65-4cad-84ee-0925583dac01'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:58 devstack cinder-volume[88796]: WARNING cinder.quota [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2120905632 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2120905632, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Created reservations ['67b1a18c-0c91-4423-b1c3-12337dce2f35', 'e69a65e1-5d14-43e7-824b-7963ba61631c', 'f42e4532-c5a3-4362-bca4-da369dea4bba', '99b70789-8953-4183-a995-b539a505f63e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:58 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:58:58 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:58 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:58 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:58:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-91b97149-9dc4-49ef-8a77-c760c2d4a9d9 tempest-GroupSnapshotsTest-1885794825 None] Delete group completed successfully. Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-975b088e-9afe-48b4-ab28-c6201e729f23-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-975b088e-9afe-48b4-ab28-c6201e729f23-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "cinder-quobyte-975b088e-9afe-48b4-ab28-c6201e729f23" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-975b088e-9afe-48b4-ab28-c6201e729f23" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cebf09-c89d-41e6-95c7-9153a510a528]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:58:59 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 Aug 03 08:58:59 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:59 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:58:59 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23 Aug 03 08:58:59 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:58:59 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-975b088e-9afe-48b4-ab28-c6201e729f23" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-quobyte-975b088e-9afe-48b4-ab28-c6201e729f23" released by "delete_volume" :: held 0.708s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:58:59 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Created reservations ['e37eb7af-02fd-4efb-96f3-cf34a341955a', '071b3a49-27be-4666-858e-2ee1348fc034', '5bb2d9b6-39ff-463e-9bcf-e665230ba19c', '62b6c046-f372-44c3-ba3a-4b8693cf79fd'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:00 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:00 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:00 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Deleted volume successfully. Aug 03 08:59:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-975ec63b-f4f0-4e65-8e3c-d73a667eb371 tempest-VolumesListTestJSON-2028338186 None] Lock "cinder-975b088e-9afe-48b4-ab28-c6201e729f23-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f326a138-b95d-453c-8d6f-a278d35c45dd tempest-GroupsV314Test-570839121 None] Group tempest-GroupsV314Test-Group-1006211160: creating Aug 03 08:59:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f326a138-b95d-453c-8d6f-a278d35c45dd tempest-GroupsV314Test-570839121 None] Group tempest-GroupsV314Test-Group-1006211160: created successfully Aug 03 08:59:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f326a138-b95d-453c-8d6f-a278d35c45dd tempest-GroupsV314Test-570839121 None] Create group completed successfully. Aug 03 08:59:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Flow 'volume_create_manager' (207ac15b-9235-4c68-9df4-846271d2c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd047ff-2f52-485d-80b7-ca1dca28ab4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edd047ff-2f52-485d-80b7-ca1dca28ab4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1669009754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62458dce-ea0e-48e2-bdf2-5a70bc906593,host='devstack@QuobyteHD#QuobyteHD',id=90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdfa140e1ed43b7a7c063b63135cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:06Z,use_quota=True,user_id='f25a8989811e4dd7b1c20d76f662288b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30945004-0289-439b-8d62-2c53933d5225),volume_type_id=30945004-0289-439b-8d62-2c53933d5225)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e47b50c-1989-42fb-a77f-556db127de80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e47b50c-1989-42fb-a77f-556db127de80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2bc8ff-d41d-4bea-be61-26a28495d3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e2bc8ff-d41d-4bea-be61-26a28495d3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2', 'volume_name': 'volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c026eb9c-aeb6-451c-a8c0-18ce7fd303a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c026eb9c-aeb6-451c-a8c0-18ce7fd303a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de73b479-0b97-4261-989a-a157e0b97cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:06 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Volume 90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2', 'volume_size': 1} Aug 03 08:59:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:08 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:08 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:08 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 08:59:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (4f2aa744-abe5-4d57-a3cd-b9bccb6b4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e94498-c4c9-47bd-830c-608e6daa1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0e94498-c4c9-47bd-830c-608e6daa1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-274442624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc038b0-58e7-4cda-8399-cabeff1df5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:14Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eaeb06-ad5a-4c3b-8c69-82f21b819c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4eaeb06-ad5a-4c3b-8c69-82f21b819c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788834da-013b-49fe-a40a-7b4a2536eb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788834da-013b-49fe-a40a-7b4a2536eb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc038b0-58e7-4cda-8399-cabeff1df5ef', 'volume_name': 'volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5900f94-706e-4516-8ba0-a9b24e8b21ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5900f94-706e-4516-8ba0-a9b24e8b21ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2c6e29-46b1-4fa0-a470-7cf56b83408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume 9cc038b0-58e7-4cda-8399-cabeff1df5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef', 'volume_size': 1} Aug 03 08:59:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f72afac0-492a-4c01-8276-c24a7834abd4 req-8cdb1ef9-c7fe-491c-b07a-ee09e200209f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Terminate volume connection completed successfully. Aug 03 08:59:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f72afac0-492a-4c01-8276-c24a7834abd4 req-8cdb1ef9-c7fe-491c-b07a-ee09e200209f tempest-TestServerVolumeAttachmentScenario-1794838478 None] Deleting attachment f2941e6e-07d5-4b4c-bba8-053da0c5b595. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Status of snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 21.699s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.982s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62458dce-ea0e-48e2-bdf2-5a70bc906593,created_at=2026-08-03T06:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1669009754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62458dce-ea0e-48e2-bdf2-5a70bc906593,host='devstack@QuobyteHD#QuobyteHD',id=90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdfa140e1ed43b7a7c063b63135cf5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:06Z,use_quota=True,user_id='f25a8989811e4dd7b1c20d76f662288b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30945004-0289-439b-8d62-2c53933d5225),volume_type_id=30945004-0289-439b-8d62-2c53933d5225)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Creating volume 90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:15 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:59:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:15 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 1073741824 Aug 03 08:59:15 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c84b5ce6-82ec-45af-8705-5a198fbb8d25 tempest-SnapshotDataIntegrityTests-1209494324 None] Create snapshot completed successfully Aug 03 08:59:16 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 1073741824" returned: 0 in 0.775s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:16 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:16 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:16 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.424s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-274442624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc038b0-58e7-4cda-8399-cabeff1df5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:14Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Creating volume 9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:16 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de73b479-0b97-4261-989a-a157e0b97cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:16 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef 1073741824 Aug 03 08:59:16 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbd1939-4182-4cfb-9b78-881a55df62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Volume volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 (90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2): created successfully Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fbd1939-4182-4cfb-9b78-881a55df62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Flow 'volume_create_manager' (207ac15b-9235-4c68-9df4-846271d2c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b920250b-3725-4b17-92ed-4589577853f3 tempest-GroupsV314Test-570839121 None] Created volume successfully. Aug 03 08:59:17 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef 1073741824" returned: 0 in 0.702s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-53fd77c7-193b-4ba8-b444-7cb5856482f2 req-f13ef9ac-3bb8-45c7-bdf2-314f66dff201 tempest-SnapshotDataIntegrityTests-1209494324 None] Terminate volume connection completed successfully. Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-53fd77c7-193b-4ba8-b444-7cb5856482f2 req-f13ef9ac-3bb8-45c7-bdf2-314f66dff201 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting attachment 7ea78385-c072-4579-9372-272c746d4743. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:17 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef Aug 03 08:59:17 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:17 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2c6e29-46b1-4fa0-a470-7cf56b83408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e70e1af-8fb5-4194-96e8-881c1b80ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef (9cc038b0-58e7-4cda-8399-cabeff1df5ef): created successfully Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e70e1af-8fb5-4194-96e8-881c1b80ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (4f2aa744-abe5-4d57-a3cd-b9bccb6b4947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3e9aa8e0-a287-4d8f-bb9b-a008d87b7c1f tempest-VolumesSnapshotTestJSON-1972819711 None] Created volume successfully. Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:18 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Cloning volume 90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 to volume d47163b8-2702-437b-af66-b708b8ed557d Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Creating offline snapshot 7288934a-6a9d-408e-b18c-c21b6b689720 of volume 90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e86bac-7135-4c2a-8327-51e169943d07]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:18 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:18 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:18 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.479s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:18 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 1G Aug 03 08:59:18 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (83b8236f-0f57-4498-b01f-f275a14cfc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aaa2eb-df5b-4f80-b641-cc37e65c968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01aaa2eb-df5b-4f80-b641-cc37e65c968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1397064314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3afc838f-7c3c-4165-ba25-0079d88dbfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fc3db0c2dd4854abf3ff8c5209539f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7bc70f25-b173-49b5-ac02-9c82b7085f41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:19Z,use_quota=True,user_id='506b16bfcf73496ea538e869170e1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ba1ce2-4fb9-482f-80ac-87279b5e8f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ba1ce2-4fb9-482f-80ac-87279b5e8f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1bb2b6-4d29-411e-9e81-677cf1ee1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb1bb2b6-4d29-411e-9e81-677cf1ee1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3afc838f-7c3c-4165-ba25-0079d88dbfa2', 'volume_name': 'volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2', 'volume_size': 1, 'snapshot_id': '7bc70f25-b173-49b5-ac02-9c82b7085f41'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34c696c-5d85-4036-9367-04006abaf1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c34c696c-5d85-4036-9367-04006abaf1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4486b2af-85ad-4190-8f39-f89a1b4cf73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:18 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Volume 3afc838f-7c3c-4165-ba25-0079d88dbfa2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2', 'volume_size': 1, 'snapshot_id': '7bc70f25-b173-49b5-ac02-9c82b7085f41'} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:19 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 1G" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:19 devstack sudo[104294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:19 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:19 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:19 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:19 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:19 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:19 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info Aug 03 08:59:19 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:20 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:20 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info Aug 03 08:59:20 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "cinder-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "cinder-quobyte-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:20 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-quobyte-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.info" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Acquiring lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[17be2911-e609-4e62-9d95-711371b88c47]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] snapshot: 7288934a-6a9d-408e-b18c-c21b6b689720, volume: d47163b8-2702-437b-af66-b708b8ed557d, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[737a3000-28b8-4dd5-b5d1-77fd210df3aa]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:20 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 Aug 03 08:59:20 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:20 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:20 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:20 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" returned: 0 in 0.376s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:20 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15 Aug 03 08:59:20 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:20 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[488f0447-62c1-4c7d-a888-a66f693f7778]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:21 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:21 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:21 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-quobyte-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15" released by "delete_volume" :: held 0.702s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Created reservations ['c61eb4d9-268d-4391-9838-05f46cab7f4d', 'a927f123-191b-4e49-a449-95c17dbb6059', 'a853bf23-91b7-4f81-b11c-36aa55706679', 'e7f1d729-a5e1-477f-838f-25fab6451ac7'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:21 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:21 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:21 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.413s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:21 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d Aug 03 08:59:21 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "cinder-ac986b90-b2c2-4306-a243-5f8204b5cd9e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-ac986b90-b2c2-4306-a243-5f8204b5cd9e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:21 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "cinder-quobyte-ac986b90-b2c2-4306-a243-5f8204b5cd9e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.312s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Deleted volume successfully. Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-quobyte-ac986b90-b2c2-4306-a243-5f8204b5cd9e" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-be5bad45-98d7-4a48-88ae-a59e56ff9f0b tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-eaec35a6-0dd0-4dee-a124-0fa8f31b6b15-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0365e3-ce28-42b4-aad0-7995290cc388]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:21 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e Aug 03 08:59:21 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:22 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e" returned: 0 in 0.704s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:22 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e Aug 03 08:59:22 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:22 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac986b90-b2c2-4306-a243-5f8204b5cd9e" returned: 0 in 0.533s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-quobyte-ac986b90-b2c2-4306-a243-5f8204b5cd9e" released by "delete_volume" :: held 1.313s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Created reservations ['b29a82aa-e4c1-4fe6-8eda-127df8cd7394', '8fe28be5-ff89-4028-a24d-f609c5330317', 'b4bd3c18-e093-4461-beb2-c84aa5eb5ff9', 'fa7766c0-3422-4448-88b8-978845c9f5e3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:23 devstack sudo[104351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:23 devstack sudo[104351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:24 devstack sudo[104351]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.771s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:24 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Deleted volume successfully. Aug 03 08:59:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3654f7c3-7a6b-4288-9182-b30af0beadb1 tempest-TestServerVolumeAttachmentScenario-1794838478 None] Lock "cinder-ac986b90-b2c2-4306-a243-5f8204b5cd9e-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:26 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d" returned: 0 in 5.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:26 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:59:26 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Converted 1024.00 MB image at 191.29 MB/s Aug 03 08:59:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d is being set with open permissions: ugo+rw: NotImplementedError Aug 03 08:59:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:26 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d Aug 03 08:59:26 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:26 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" released by "_copy_volume_from_snapshot" :: held 6.506s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Acquiring lock "cinder-quobyte-7288934a-6a9d-408e-b18c-c21b6b689720" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-7288934a-6a9d-408e-b18c-c21b6b689720" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Deleting offline snapshot 7288934a-6a9d-408e-b18c-c21b6b689720 of volume 90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] snapshot_file for this snap is: volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a5c9f1-9519-479e-aae0-1cff6268a7e2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:27 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:27 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:27 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.433s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cb0338-d4ba-405d-af36-fe8486e3b699]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:27 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:27 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:28 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.662s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:28 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:28 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:28 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.476s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:28 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720 Aug 03 08:59:28 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:29 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2.7288934a-6a9d-408e-b18c-c21b6b689720" returned: 0 in 0.387s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-7288934a-6a9d-408e-b18c-c21b6b689720" released by "_delete_snapshot" :: held 2.117s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.267s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41-3afc838f-7c3c-4165-ba25-0079d88dbfa2" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41-3afc838f-7c3c-4165-ba25-0079d88dbfa2" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Creating volume 3afc838f-7c3c-4165-ba25-0079d88dbfa2 from snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot: 7bc70f25-b173-49b5-ac02-9c82b7085f41, volume: 3afc838f-7c3c-4165-ba25-0079d88dbfa2, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf00a9b-0490-478d-92ae-8928b5cc4465]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-371a788b-28a1-4608-bf88-8527970c627f tempest-GroupsV314Test-570839121 None] Create group from source-group-62458dce-ea0e-48e2-bdf2-5a70bc906593 completed successfully. Aug 03 08:59:29 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 08:59:29 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:29 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.426s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[851cab5a-2c27-482f-aaf8-c15f87f804ae]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:29 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 08:59:29 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:30 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:59:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:59:30 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:59:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:30 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 Aug 03 08:59:30 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Acquiring lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" acquired by "delete_volume" :: waited 0.051s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7b242f-92d1-46dc-b4d4-8b44a0704c44]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:31 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d Aug 03 08:59:31 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:32 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d" returned: 0 in 1.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:32 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d Aug 03 08:59:32 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:33 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d47163b8-2702-437b-af66-b708b8ed557d" returned: 0 in 0.981s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-d47163b8-2702-437b-af66-b708b8ed557d" released by "delete_volume" :: held 2.484s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Created reservations ['beb679bd-f488-4b23-a094-8fb2c3bf3e0f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:33 devstack cinder-volume[88796]: WARNING cinder.quota [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1769219175 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1769219175, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:59:33 devstack cinder-volume[88796]: WARNING cinder.quota [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1769219175 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1769219175, it is now deprecated. Please use the default quota class for default quota. Aug 03 08:59:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Created reservations ['dc0ccc27-d1eb-41d7-9338-28a3ef6811a7', '168e7e1d-0d29-4c88-a948-5d3a7f2d4aa2', 'e7f06335-0da7-4b24-8b43-546a51d897c4', '0c19562b-fad1-4562-8c30-7f6fd110d37b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:34 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:34 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:35 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.777s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:35 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9680f21e-df09-4c85-a7e0-a0cf92aca9b6 tempest-GroupsV314Test-570839121 None] Delete group completed successfully. Aug 03 08:59:35 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2" returned: 0 in 5.568s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:35 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:59:35 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Converted 1024.00 MB image at 183.85 MB/s Aug 03 08:59:35 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 is being set with open permissions: ugo+rw Aug 03 08:59:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:35 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 Aug 03 08:59:35 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Acquiring lock "cinder-quobyte-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e311e0d-bac9-4bc2-aa92-c09088aaa205]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:36 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" released by "_copy_volume_from_snapshot" :: held 6.897s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41-3afc838f-7c3c-4165-ba25-0079d88dbfa2" released by "_create_volume_from_snapshot" :: held 7.003s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.037s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.238s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:36 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:36 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Creating offline snapshot 8d6da9f1-8a9e-495a-a71e-ac591a3b0912 of volume 9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4486b2af-85ad-4190-8f39-f89a1b4cf73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2', 'volume_size': 1, 'snapshot_id': '7bc70f25-b173-49b5-ac02-9c82b7085f41'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344b68bb-89a7-49a1-9774-cca31d78179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3620783b-744e-4734-8e0a-9a4cfdddc5ab]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:36 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Volume volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 (3afc838f-7c3c-4165-ba25-0079d88dbfa2): created successfully Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344b68bb-89a7-49a1-9774-cca31d78179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (83b8236f-0f57-4498-b01f-f275a14cfc43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2a2dada3-10dd-49ed-89d8-2fba95be537d tempest-SnapshotDataIntegrityTests-1209494324 None] Created volume successfully. Aug 03 08:59:36 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef Aug 03 08:59:36 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:36 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.466s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:36 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2 Aug 03 08:59:36 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:36 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:36 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 1G Aug 03 08:59:36 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:36 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Lock "cinder-quobyte-90b9b97c-4373-4a37-9d6b-4a3f6c3f26b2" released by "delete_volume" :: held 0.905s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Created reservations ['d597d66c-2045-44bc-aa15-801f38eaab90'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Created reservations ['a7817276-8fc9-40de-ac3e-b9949744fb80', '0d514699-d5ec-4cb5-8903-576d5961e08f', '7191919c-bfe4-44c8-9120-a3be10a3a246', 'f6640b0e-3321-4a65-8a86-f95f5fb5ff64'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:37 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:37 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:37 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 1G" returned: 0 in 0.789s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:37 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 Aug 03 08:59:37 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:37 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.611s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:37 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9ba24c80-8ec7-4123-a717-2a118f17c0d1 tempest-GroupsV314Test-570839121 None] Delete group completed successfully. Aug 03 08:59:38 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912" returned: 0 in 0.561s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:38 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 is being set with open permissions: ugo+rw Aug 03 08:59:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:38 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 Aug 03 08:59:38 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d3208518-9b03-4c68-9746-510fe46ba232 req-5d196212-3df4-42e4-b970-0432edf7d775 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:38 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912" returned: 0 in 0.489s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:38 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info Aug 03 08:59:38 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:39 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:39 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info is being set with open permissions: ugo+rw Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:39 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info Aug 03 08:59:39 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:39 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.info" returned: 0 in 0.435s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.342s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d3208518-9b03-4c68-9746-510fe46ba232 req-5d196212-3df4-42e4-b970-0432edf7d775 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.942s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d3208518-9b03-4c68-9746-510fe46ba232 req-5d196212-3df4-42e4-b970-0432edf7d775 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-d3208518-9b03-4c68-9746-510fe46ba232 req-5d196212-3df4-42e4-b970-0432edf7d775 tempest-SnapshotDataIntegrityTests-1209494324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6836c8b5-d972-4b17-8870-c92ebb3268ad', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:59:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d40c8523-df67-4efd-80e0-417858e49461 tempest-VolumesSnapshotTestJSON-1972819711 None] Create snapshot completed successfully Aug 03 08:59:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-d3208518-9b03-4c68-9746-510fe46ba232 req-5d196212-3df4-42e4-b970-0432edf7d775 tempest-SnapshotDataIntegrityTests-1209494324 None] attachment_update completed successfully. Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-8d6da9f1-8a9e-495a-a71e-ac591a3b0912-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-8d6da9f1-8a9e-495a-a71e-ac591a3b0912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-8d6da9f1-8a9e-495a-a71e-ac591a3b0912" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-8d6da9f1-8a9e-495a-a71e-ac591a3b0912" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Deleting offline snapshot 8d6da9f1-8a9e-495a-a71e-ac591a3b0912 of volume 9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 08:59:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] snapshot_file for this snap is: volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5548bedd-c87f-4e86-a9b3-2a8b1e3d752b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:41 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 Aug 03 08:59:41 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:41 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f62547-d77d-4d27-9391-cc49300a95af]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:41 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef Aug 03 08:59:41 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:41 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef" returned: 0 in 0.472s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:42 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 Aug 03 08:59:42 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:42 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:42 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912 Aug 03 08:59:42 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:42 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef.8d6da9f1-8a9e-495a-a71e-ac591a3b0912" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-8d6da9f1-8a9e-495a-a71e-ac591a3b0912" released by "_delete_snapshot" :: held 1.914s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" released by "delete_snapshot" :: held 1.945s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['9acacffa-9547-45d1-8858-65773409be90', 'b8c9fc64-719d-4f5b-8852-a531ede70ca2', 'd7534f79-5ccd-4dff-a1fc-769c52da075a', '0b78269c-9341-4f02-8d79-434b19ff92dd'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 08:59:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Delete snapshot completed successfully. Aug 03 08:59:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7880a8bd-3a11-40fa-afcc-e66e0e95428f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-8d6da9f1-8a9e-495a-a71e-ac591a3b0912-delete_snapshot" released by "delete_snapshot" :: held 2.221s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-e8471e70-6f17-4fde-a3c9-9775fe1e7bca req-2fc9eb39-0dcb-4796-9465-46ec1fc27c7b tempest-SnapshotDataIntegrityTests-1209494324 None] Terminate volume connection completed successfully. Aug 03 08:59:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-e8471e70-6f17-4fde-a3c9-9775fe1e7bca req-2fc9eb39-0dcb-4796-9465-46ec1fc27c7b tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting attachment 6836c8b5-d972-4b17-8870-c92ebb3268ad. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 08:59:44 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (16a52012-1330-438a-9f4c-945c1c16c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3495ed6f-8474-4a0d-b48b-2294ea5f3ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3495ed6f-8474-4a0d-b48b-2294ea5f3ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1006614170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65091d91-ff2e-4afe-926b-6a4d0a265e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:45Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5c0dd6-5f4b-44fe-bf82-31515ded5ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5c0dd6-5f4b-44fe-bf82-31515ded5ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942ad78-d5b7-4dc6-9ddd-56c653766c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a942ad78-d5b7-4dc6-9ddd-56c653766c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65091d91-ff2e-4afe-926b-6a4d0a265e48', 'volume_name': 'volume-65091d91-ff2e-4afe-926b-6a4d0a265e48', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6079fb71-901f-4ed1-8cc3-4b503d85a416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6079fb71-901f-4ed1-8cc3-4b503d85a416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4697cd59-eae1-4b53-b104-975693e8fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume 65091d91-ff2e-4afe-926b-6a4d0a265e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65091d91-ff2e-4afe-926b-6a4d0a265e48', 'volume_size': 1} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1006614170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65091d91-ff2e-4afe-926b-6a4d0a265e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:45Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Creating volume 65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:45 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 1073741824 Aug 03 08:59:45 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (61304586-aa64-416b-bebc-e5ff40bb6b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea140175-3e17-4d27-a471-3988c3197fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea140175-3e17-4d27-a471-3988c3197fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1986052481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b696cff1-b477-493e-ac0d-571bebeb4be0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fc3db0c2dd4854abf3ff8c5209539f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ad4bc5d-72fe-4e57-a4b5-518f9711e554,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:45Z,use_quota=True,user_id='506b16bfcf73496ea538e869170e1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1cf870-5741-431e-8e14-2b6e2c367ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad1cf870-5741-431e-8e14-2b6e2c367ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcb3f7a-2b1c-4843-bd3f-bcfbab23e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcb3f7a-2b1c-4843-bd3f-bcfbab23e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b696cff1-b477-493e-ac0d-571bebeb4be0', 'volume_name': 'volume-b696cff1-b477-493e-ac0d-571bebeb4be0', 'volume_size': 1, 'snapshot_id': '6ad4bc5d-72fe-4e57-a4b5-518f9711e554'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1620f3ff-c13d-4ad9-866e-6786e29b87cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1620f3ff-c13d-4ad9-866e-6786e29b87cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912ef2de-b3f5-4a8f-b6ea-dea7e8ccda1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume b696cff1-b477-493e-ac0d-571bebeb4be0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b696cff1-b477-493e-ac0d-571bebeb4be0', 'volume_size': 1, 'snapshot_id': '6ad4bc5d-72fe-4e57-a4b5-518f9711e554'} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:45 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 1073741824" returned: 0 in 0.684s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:45 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 08:59:45 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:46 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.410s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-b696cff1-b477-493e-ac0d-571bebeb4be0" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4697cd59-eae1-4b53-b104-975693e8fde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65091d91-ff2e-4afe-926b-6a4d0a265e48', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905cd78b-d119-4b5d-88bb-623c132a73e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-b696cff1-b477-493e-ac0d-571bebeb4be0" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating volume b696cff1-b477-493e-ac0d-571bebeb4be0 from snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Volume volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 (65091d91-ff2e-4afe-926b-6a4d0a265e48): created successfully Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905cd78b-d119-4b5d-88bb-623c132a73e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (16a52012-1330-438a-9f4c-945c1c16c679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot: 6ad4bc5d-72fe-4e57-a4b5-518f9711e554, volume: b696cff1-b477-493e-ac0d-571bebeb4be0, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:59:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-803153b6-4690-4ff5-9414-db5ea2128e6f tempest-VolumesSnapshotTestJSON-1972819711 None] Created volume successfully. Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0faa68-0f65-4396-b2cb-eb1b1c08d249]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:46 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 08:59:46 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:46 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.468s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed7cc5c-6ddb-46a3-9707-84942c55a361]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:46 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 08:59:46 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:47 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.471s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:47 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 Aug 03 08:59:47 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:53 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0" returned: 0 in 6.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:53 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 08:59:53 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Converted 1024.00 MB image at 158.89 MB/s Aug 03 08:59:53 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 is being set with open permissions: ugo+rw Aug 03 08:59:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:53 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 Aug 03 08:59:53 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:53 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" released by "_copy_volume_from_snapshot" :: held 7.808s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-b696cff1-b477-493e-ac0d-571bebeb4be0" released by "_create_volume_from_snapshot" :: held 7.914s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.955s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.515s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Creating offline snapshot 5481f844-d651-47d7-a8dc-1115d99f265d of volume 65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912ef2de-b3f5-4a8f-b6ea-dea7e8ccda1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b696cff1-b477-493e-ac0d-571bebeb4be0', 'volume_size': 1, 'snapshot_id': '6ad4bc5d-72fe-4e57-a4b5-518f9711e554'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7e427e-9a1d-4fc8-8513-0cb02c5d704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[da89b626-fcdb-4bdb-9ccb-55d4f7bd472e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume volume-b696cff1-b477-493e-ac0d-571bebeb4be0 (b696cff1-b477-493e-ac0d-571bebeb4be0): created successfully Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7e427e-9a1d-4fc8-8513-0cb02c5d704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (61304586-aa64-416b-bebc-e5ff40bb6b29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4c855d22-c8fc-46aa-8cbe-cdf84f726934 tempest-SnapshotDataIntegrityTests-1209494324 None] Created volume successfully. Aug 03 08:59:54 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 08:59:54 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Flow 'volume_create_manager' (a1b80742-5263-4e16-98ac-d8c3f290c71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea40feb-904d-4e4c-8755-b57d0c2fc59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ea40feb-904d-4e4c-8755-b57d0c2fc59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-974618810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a394b0ee-013e-4669-9a88-766ab66a6587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0221b528614617bf5068933ac860d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:54Z,use_quota=True,user_id='80a9dd218479478cbc7119b3438e5f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b3ad84-4625-4dee-be11-29446b67edfb),volume_type_id=67b3ad84-4625-4dee-be11-29446b67edfb)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c4972d-ecb2-435f-9d04-1b5930b08179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c4972d-ecb2-435f-9d04-1b5930b08179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc2b5cc-6982-4a06-87c6-0ee3681e1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fc2b5cc-6982-4a06-87c6-0ee3681e1aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a394b0ee-013e-4669-9a88-766ab66a6587', 'volume_name': 'volume-a394b0ee-013e-4669-9a88-766ab66a6587', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc549a0-91fc-4b23-bc95-eb8b31d1cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc549a0-91fc-4b23-bc95-eb8b31d1cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad681d75-9d5a-4dd5-a938-a772f5847cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Volume a394b0ee-013e-4669-9a88-766ab66a6587: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a394b0ee-013e-4669-9a88-766ab66a6587', 'volume_size': 1} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:54 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 0.479s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:54 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d 1G Aug 03 08:59:54 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:55 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d 1G" returned: 0 in 0.596s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:55 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 08:59:55 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:55 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 0.464s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:55 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d is being set with open permissions: ugo+rw Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:55 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 08:59:55 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-63d549f5-2f32-48b2-a57f-a856e8bea9de req-e1b4a33b-01fd-4646-8056-f834a6233ebe tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:55 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:56 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info Aug 03 08:59:56 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:56 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:56 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info is being set with open permissions: ugo+rw Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:56 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info Aug 03 08:59:56 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:56 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.info" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-974618810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a394b0ee-013e-4669-9a88-766ab66a6587,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0221b528614617bf5068933ac860d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:54Z,use_quota=True,user_id='80a9dd218479478cbc7119b3438e5f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(67b3ad84-4625-4dee-be11-29446b67edfb),volume_type_id=67b3ad84-4625-4dee-be11-29446b67edfb)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Creating volume a394b0ee-013e-4669-9a88-766ab66a6587 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:56 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 08:59:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:56 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 1073741824 Aug 03 08:59:56 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-25353a78-c50e-4856-8344-b3ee56b946b3 tempest-VolumesSnapshotTestJSON-1972819711 None] Create snapshot completed successfully Aug 03 08:59:57 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 1073741824" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:57 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 Aug 03 08:59:57 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:57 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-63d549f5-2f32-48b2-a57f-a856e8bea9de req-e1b4a33b-01fd-4646-8056-f834a6233ebe tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.698s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-63d549f5-2f32-48b2-a57f-a856e8bea9de req-e1b4a33b-01fd-4646-8056-f834a6233ebe tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad681d75-9d5a-4dd5-a938-a772f5847cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a394b0ee-013e-4669-9a88-766ab66a6587', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e9557f-9487-4d00-992b-40f95cd9710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:57 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Volume volume-a394b0ee-013e-4669-9a88-766ab66a6587 (a394b0ee-013e-4669-9a88-766ab66a6587): created successfully Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e9557f-9487-4d00-992b-40f95cd9710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Flow 'volume_create_manager' (a1b80742-5263-4e16-98ac-d8c3f290c71d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-20c4017c-3f62-4e32-a3f6-d3a5909dd12c tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Created volume successfully. Aug 03 08:59:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-63d549f5-2f32-48b2-a57f-a856e8bea9de req-e1b4a33b-01fd-4646-8056-f834a6233ebe tempest-SnapshotDataIntegrityTests-1209494324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-b696cff1-b477-493e-ac0d-571bebeb4be0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7582d1dc-98d4-468e-97d8-57c82318810b', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 08:59:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-63d549f5-2f32-48b2-a57f-a856e8bea9de req-e1b4a33b-01fd-4646-8056-f834a6233ebe tempest-SnapshotDataIntegrityTests-1209494324 None] attachment_update completed successfully. Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=116,cinder:INSERT=22,cinder:UPDATE=100,cinder:DELETE=5 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=104,cinder:INSERT=23,cinder:UPDATE=99,cinder:DELETE=8 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (567228ed-0509-4211-98ea-95974bab2e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4accebca-f77e-4573-957d-84ead8537457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4accebca-f77e-4573-957d-84ead8537457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T06:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-786339161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f06b28b6-aeff-4b65-b5b2-5df57b4130f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T06:59:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5481f844-d651-47d7-a8dc-1115d99f265d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T06:59:58Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0665bb99-2368-46ec-8fb7-83ac9d435993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0665bb99-2368-46ec-8fb7-83ac9d435993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0525b78-ae5c-4d08-be4d-9f4154f21d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0525b78-ae5c-4d08-be4d-9f4154f21d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f06b28b6-aeff-4b65-b5b2-5df57b4130f1', 'volume_name': 'volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1', 'volume_size': 2, 'snapshot_id': '5481f844-d651-47d7-a8dc-1115d99f265d'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45350047-cbc9-4e72-9018-fa25a05b1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45350047-cbc9-4e72-9018-fa25a05b1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f9759-83dd-4495-99b2-0caebb04b278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 08:59:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume f06b28b6-aeff-4b65-b5b2-5df57b4130f1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1', 'volume_size': 2, 'snapshot_id': '5481f844-d651-47d7-a8dc-1115d99f265d'} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Creating volume f06b28b6-aeff-4b65-b5b2-5df57b4130f1 from snapshot 5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] snapshot: 5481f844-d651-47d7-a8dc-1115d99f265d, volume: f06b28b6-aeff-4b65-b5b2-5df57b4130f1, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31bb8b-8d11-40c0-a56e-bfa9dafca1d1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 08:59:58 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 08:59:58 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 08:59:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:58 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 08:59:58 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:59 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 0.567s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65091d91-ff2e-4afe-926b-6a4d0a265e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 08:59:59 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d0264-e8d0-4e1e-8cbf-15c2f8a17dd7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.471s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 08:59:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6a51a8c2-f640-438e-a098-ba1e0c714768 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Retype volume completed successfully. Aug 03 08:59:59 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 08:59:59 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:59 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 0.494s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 08:59:59 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 Aug 03 08:59:59 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "cinder-a394b0ee-013e-4669-9a88-766ab66a6587-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "cinder-a394b0ee-013e-4669-9a88-766ab66a6587-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 08:59:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "cinder-quobyte-a394b0ee-013e-4669-9a88-766ab66a6587" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "cinder-quobyte-a394b0ee-013e-4669-9a88-766ab66a6587" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[14afe21c-3b65-4bf7-ba42-0d0883422f20]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:00 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 Aug 03 09:00:00 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:00 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587" returned: 0 in 0.661s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:00 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587 Aug 03 09:00:00 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:01 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a394b0ee-013e-4669-9a88-766ab66a6587" returned: 0 in 0.860s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "cinder-quobyte-a394b0ee-013e-4669-9a88-766ab66a6587" released by "delete_volume" :: held 1.622s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:01 devstack cinder-volume[88796]: WARNING cinder.quota [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:00:01 devstack cinder-volume[88796]: WARNING cinder.quota [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Created reservations ['e243a6f8-59bf-4147-9dab-d52a0bb99400', '774aae3e-104d-4d57-8fdd-34c550ef83f5', '7b58dc96-4145-432b-bdc6-68e81b5e9564', '8ce16e82-6a47-4e29-91db-7f6f4a77986a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:02 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:02 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:03 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.938s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:03 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Deleted volume successfully. Aug 03 09:00:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6cb8a7e9-85f1-4321-b737-64b6ed551b10 tempest-VolumeRetypeWithoutMigrationTest-803368472 None] Lock "cinder-a394b0ee-013e-4669-9a88-766ab66a6587-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-2a92ea1a-e610-43f2-8a08-b781f7a9681b req-c0072f8b-cbdf-4e2c-95c1-56de649915db tempest-SnapshotDataIntegrityTests-1209494324 None] Terminate volume connection completed successfully. Aug 03 09:00:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-2a92ea1a-e610-43f2-8a08-b781f7a9681b req-c0072f8b-cbdf-4e2c-95c1-56de649915db tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting attachment 7582d1dc-98d4-468e-97d8-57c82318810b. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:00:06 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" returned: 0 in 6.820s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:06 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:00:06 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Converted 1024.00 MB image at 150.13 MB/s Aug 03 09:00:06 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 is being set with open permissions: ugo+rw Aug 03 09:00:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:06 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 Aug 03 09:00:06 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:06 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" released by "_copy_volume_from_snapshot" :: held 8.389s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" released by "_create_volume_from_snapshot" :: held 8.505s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.547s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f9759-83dd-4495-99b2-0caebb04b278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1', 'volume_size': 2, 'snapshot_id': '5481f844-d651-47d7-a8dc-1115d99f265d'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81132ae-d51a-4d28-a8cf-641da0b0ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 (f06b28b6-aeff-4b65-b5b2-5df57b4130f1): created successfully Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81132ae-d51a-4d28-a8cf-641da0b0ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (567228ed-0509-4211-98ea-95974bab2e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-10081210-68ec-49c4-be19-c4b536555530 tempest-VolumesSnapshotTestJSON-1972819711 None] Created volume successfully. Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (f241310f-faa1-42d1-b51b-d4d3f4af0abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255d10a5-ae02-4343-8044-739ca9af47ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255d10a5-ae02-4343-8044-739ca9af47ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1857056689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068a2d2b-4534-4d17-be19-e0da9c3dd938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34fc3db0c2dd4854abf3ff8c5209539f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f57b4d00-a7bd-4226-af9d-d68b0472a341,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:07Z,use_quota=True,user_id='506b16bfcf73496ea538e869170e1fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6aa369-a9b3-46d0-b1fd-73ae103e9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad6aa369-a9b3-46d0-b1fd-73ae103e9c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3518a0db-a7b9-4222-8ddb-c1e8a70c392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3518a0db-a7b9-4222-8ddb-c1e8a70c392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '068a2d2b-4534-4d17-be19-e0da9c3dd938', 'volume_name': 'volume-068a2d2b-4534-4d17-be19-e0da9c3dd938', 'volume_size': 1, 'snapshot_id': 'f57b4d00-a7bd-4226-af9d-d68b0472a341'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32a2fec-11a3-4967-a047-7f5a44838518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a32a2fec-11a3-4967-a047-7f5a44838518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5870c9ea-383b-4264-a7be-19470e58fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:07 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume 068a2d2b-4534-4d17-be19-e0da9c3dd938: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-068a2d2b-4534-4d17-be19-e0da9c3dd938', 'volume_size': 1, 'snapshot_id': 'f57b4d00-a7bd-4226-af9d-d68b0472a341'} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341-068a2d2b-4534-4d17-be19-e0da9c3dd938" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341-068a2d2b-4534-4d17-be19-e0da9c3dd938" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating volume 068a2d2b-4534-4d17-be19-e0da9c3dd938 from snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot: f57b4d00-a7bd-4226-af9d-d68b0472a341, volume: 068a2d2b-4534-4d17-be19-e0da9c3dd938, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf4f8f1-7237-42a0-baa2-5ec9628ecd10]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:07 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 09:00:07 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-f06b28b6-aeff-4b65-b5b2-5df57b4130f1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-f06b28b6-aeff-4b65-b5b2-5df57b4130f1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[95786630-e947-40fb-9301-d73d54d894f2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:08 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6c410c-5bca-43f7-9343-481201a8f744]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:08 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 Aug 03 09:00:08 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:08 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 09:00:08 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:08 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" returned: 0 in 0.472s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:08 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1 Aug 03 09:00:08 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:08 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:08 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 Aug 03 09:00:08 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:08 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-f06b28b6-aeff-4b65-b5b2-5df57b4130f1" released by "delete_volume" :: held 0.915s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:08 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:08 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['c6db4a3f-32c1-416a-a138-a21fbe443add', 'a5d58564-fe72-4f14-8c4c-bffff647713b', 'cd6cd21d-95d3-40f2-a923-fff1376080fa', '00cdde43-ef4b-41b0-9a52-8a39d79898a8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:09 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:09 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:09 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.519s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:00:09 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.361s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleted volume successfully. Aug 03 09:00:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-16d9230d-609d-4daf-b57c-8c39ee7159a7 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-f06b28b6-aeff-4b65-b5b2-5df57b4130f1-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-5481f844-d651-47d7-a8dc-1115d99f265d-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-5481f844-d651-47d7-a8dc-1115d99f265d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleting offline snapshot 5481f844-d651-47d7-a8dc-1115d99f265d of volume 65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] snapshot_file for this snap is: volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[041adc35-f69e-4a16-aa6b-5e060e97bef8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:11 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 09:00:11 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:11 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 0.825s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65091d91-ff2e-4afe-926b-6a4d0a265e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acfb2a7-5148-41f5-8a83-83cd2374a424]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:12 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 09:00:12 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:13 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 1.898s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:13 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 09:00:13 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:14 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 1.233s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:14 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d Aug 03 09:00:14 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:15 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48.5481f844-d651-47d7-a8dc-1115d99f265d" returned: 0 in 0.880s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:15 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938" returned: 0 in 7.194s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:00:15 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Converted 1024.00 MB image at 142.32 MB/s Aug 03 09:00:15 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 is being set with open permissions: ugo+rw Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:15 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 Aug 03 09:00:15 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-5481f844-d651-47d7-a8dc-1115d99f265d" released by "_delete_snapshot" :: held 5.228s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" released by "delete_snapshot" :: held 5.312s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:15 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['a5dde30b-08d1-4a30-8738-ddc7255f565d', 'de51d60f-bc50-4823-9f84-3caf68130ab7', '996926c0-6256-49b4-8221-9824af676f07', '41a7de93-d396-466c-a44b-5bcdc27718a0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Flow 'volume_create_manager' (cbe64060-8865-49c3-9343-d03f7979566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4491af08-02c9-4da0-93d1-045af68cd96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4491af08-02c9-4da0-93d1-045af68cd96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-22952913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861ecd8-aa15-42ba-80b4-0cb3de5cbecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437236701c5f4a3d9567e2b292d874c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:16Z,use_quota=True,user_id='c0ba77463f4a42ab9b0466e6626cd084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef32cd86-bff0-44b5-be70-62bef235327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef32cd86-bff0-44b5-be70-62bef235327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619ea20-a101-4799-bb59-ceb569671741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619ea20-a101-4799-bb59-ceb569671741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c861ecd8-aa15-42ba-80b4-0cb3de5cbecb', 'volume_name': 'volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15370fe9-a1e2-4f18-a209-1d8768bf4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15370fe9-a1e2-4f18-a209-1d8768bf4497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8d716-d4cd-4fc1-9874-cc0ff92b5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Volume c861ecd8-aa15-42ba-80b4-0cb3de5cbecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb', 'volume_size': 1} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Delete snapshot completed successfully. Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-360d7d39-e05b-4a93-82b1-bcf3a8743478 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-5481f844-d651-47d7-a8dc-1115d99f265d-delete_snapshot" released by "delete_snapshot" :: held 5.698s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:16 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938" returned: 0 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" released by "_copy_volume_from_snapshot" :: held 8.779s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-65091d91-ff2e-4afe-926b-6a4d0a265e48-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-65091d91-ff2e-4afe-926b-6a4d0a265e48-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341-068a2d2b-4534-4d17-be19-e0da9c3dd938" released by "_create_volume_from_snapshot" :: held 8.898s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.925s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-22952913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c861ecd8-aa15-42ba-80b4-0cb3de5cbecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='437236701c5f4a3d9567e2b292d874c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:16Z,use_quota=True,user_id='c0ba77463f4a42ab9b0466e6626cd084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Creating volume c861ecd8-aa15-42ba-80b4-0cb3de5cbecb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:16 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:16 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb 1073741824 Aug 03 09:00:16 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5870c9ea-383b-4264-a7be-19470e58fc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068a2d2b-4534-4d17-be19-e0da9c3dd938', 'volume_size': 1, 'snapshot_id': 'f57b4d00-a7bd-4226-af9d-d68b0472a341'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca5fc51-a17f-4f01-b22e-e4022da02659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Volume volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 (068a2d2b-4534-4d17-be19-e0da9c3dd938): created successfully Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca5fc51-a17f-4f01-b22e-e4022da02659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Flow 'volume_create_manager' (f241310f-faa1-42d1-b51b-d4d3f4af0abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d3074f26-be99-4355-94da-2e2b997ed733 tempest-SnapshotDataIntegrityTests-1209494324 None] Created volume successfully. Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dda26d-f094-4f7d-ae95-b56757445149]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:16 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 09:00:16 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:16 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb 1073741824" returned: 0 in 0.611s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:17 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb Aug 03 09:00:17 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:17 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 0.502s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:17 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48 Aug 03 09:00:17 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:17 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a8d716-d4cd-4fc1-9874-cc0ff92b5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:17 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bbb112-2a95-4212-aa2d-f1643d3bf7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65091d91-ff2e-4afe-926b-6a4d0a265e48" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-65091d91-ff2e-4afe-926b-6a4d0a265e48" released by "delete_volume" :: held 0.866s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:17 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Volume volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb (c861ecd8-aa15-42ba-80b4-0cb3de5cbecb): created successfully Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bbb112-2a95-4212-aa2d-f1643d3bf7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Flow 'volume_create_manager' (cbe64060-8865-49c3-9343-d03f7979566e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-76dd33e6-d47a-4d7c-8164-cf9ea390191c tempest-VolumesServicesTestJSON-381372434 None] Created volume successfully. Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['19991d6b-79e1-42fc-8027-168d69a7e99f', 'f2478bb7-b4d5-4219-a6ad-6cb458655aff', 'd391fdb6-2f62-45cc-a188-57ce3e5c15e3', '151b7164-5832-451f-9573-418426bf443e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:17 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:17 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:17 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleted volume successfully. Aug 03 09:00:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-28fcfa6a-afda-4d90-9ada-f26eb6332801 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-65091d91-ff2e-4afe-926b-6a4d0a265e48-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Acquiring lock "cinder-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "cinder-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Acquiring lock "cinder-quobyte-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "cinder-quobyte-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf8265-6e00-41a8-9055-e5c50bd5cb06]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:18 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb Aug 03 09:00:18 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c374dfd3-84dc-4677-8b7a-fa2fd9b2ecdf req-abefc6b7-a596-4b09-a5e0-32ec064cf82b tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c374dfd3-84dc-4677-8b7a-fa2fd9b2ecdf req-abefc6b7-a596-4b09-a5e0-32ec064cf82b tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-c374dfd3-84dc-4677-8b7a-fa2fd9b2ecdf req-abefc6b7-a596-4b09-a5e0-32ec064cf82b tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-c374dfd3-84dc-4677-8b7a-fa2fd9b2ecdf req-abefc6b7-a596-4b09-a5e0-32ec064cf82b tempest-SnapshotDataIntegrityTests-1209494324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-068a2d2b-4534-4d17-be19-e0da9c3dd938', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51ce2fe1-b85f-4614-a99c-e003718bce92', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:00:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-c374dfd3-84dc-4677-8b7a-fa2fd9b2ecdf req-abefc6b7-a596-4b09-a5e0-32ec064cf82b tempest-SnapshotDataIntegrityTests-1209494324 None] attachment_update completed successfully. Aug 03 09:00:19 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" returned: 0 in 0.631s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:19 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb Aug 03 09:00:19 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:19 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "cinder-quobyte-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb" released by "delete_volume" :: held 1.129s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (e736c45c-b981-4104-9d43-6eb2e0b73903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce5fcd1-00f2-45f8-9df4-2c8e84c763b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce5fcd1-00f2-45f8-9df4-2c8e84c763b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1193384853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568a77d0-e1f0-4ef6-b99a-09d84ea78f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:20Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a398b1a-1465-436e-8cc4-110dba0adc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a398b1a-1465-436e-8cc4-110dba0adc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8200385-0c16-4713-badf-a5ad8caa86c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8200385-0c16-4713-badf-a5ad8caa86c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568a77d0-e1f0-4ef6-b99a-09d84ea78f43', 'volume_name': 'volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f940351-6e11-4d64-b43d-86e163569b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f940351-6e11-4d64-b43d-86e163569b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c5d67-b8c7-4a22-a5ce-865378a5ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:19 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume 568a77d0-e1f0-4ef6-b99a-09d84ea78f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43', 'volume_size': 1} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1193384853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568a77d0-e1f0-4ef6-b99a-09d84ea78f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:20Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Creating volume 568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:19 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:19 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 1073741824 Aug 03 09:00:19 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Created reservations ['38520ff4-115c-47db-a140-50bb764be53b', '313a52d2-c8d2-400a-9b98-aef40a5d90f9', '281b517e-6b0c-43ad-8c1d-95384a71dd2b', '2abc3ed3-30fc-43e4-8b51-e60cc015aa26'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:19 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:19 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:20 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Deleted volume successfully. Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-02396b75-d14c-45d5-bab3-9b24ba282c2c tempest-VolumesServicesTestJSON-381372434 None] Lock "cinder-c861ecd8-aa15-42ba-80b4-0cb3de5cbecb-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:20 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 1073741824" returned: 0 in 0.693s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:20 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:20 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:20 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7c5d67-b8c7-4a22-a5ce-865378a5ec15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e734bb6a-7144-449c-9852-f326db646f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:20 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Volume volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 (568a77d0-e1f0-4ef6-b99a-09d84ea78f43): created successfully Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e734bb6a-7144-449c-9852-f326db646f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (e736c45c-b981-4104-9d43-6eb2e0b73903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7bacd25e-d506-45fe-9512-52046801fb60 tempest-VolumesSnapshotTestJSON-1972819711 None] Created volume successfully. Aug 03 09:00:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Creating offline snapshot 39eff402-9e02-4106-a9d3-07f862a46687 of volume 568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:00:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b67430-92f4-4d73-81c8-d7477625b2e5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:22 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:22 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:22 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.636s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:22 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 1G Aug 03 09:00:22 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-b6b5d867-cfe2-44bb-933b-82633c1961be req-9febc08c-0e1c-447e-a2bb-6bffe608aac1 tempest-SnapshotDataIntegrityTests-1209494324 None] Terminate volume connection completed successfully. Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-b6b5d867-cfe2-44bb-933b-82633c1961be req-9febc08c-0e1c-447e-a2bb-6bffe608aac1 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting attachment 51ce2fe1-b85f-4614-a99c-e003718bce92. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:00:23 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 1G" returned: 0 in 0.681s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:23 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:23 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:23 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.476s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:23 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 is being set with open permissions: ugo+rw Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-068a2d2b-4534-4d17-be19-e0da9c3dd938-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:23 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:23 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-068a2d2b-4534-4d17-be19-e0da9c3dd938-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ae3532-b611-4b4e-b2b3-094868b3db1e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:24 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 Aug 03 09:00:24 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:24 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.428s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:24 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info Aug 03 09:00:24 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:24 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938" returned: 0 in 0.532s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:24 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938 Aug 03 09:00:24 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:24 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:24 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info is being set with open permissions: ugo+rw Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:24 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info Aug 03 09:00:24 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:24 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-068a2d2b-4534-4d17-be19-e0da9c3dd938" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-068a2d2b-4534-4d17-be19-e0da9c3dd938" released by "delete_volume" :: held 0.933s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:24 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.info" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e269bff0-6b1a-492a-b7cb-60e6379e173d tempest-VolumesSnapshotTestJSON-1972819711 None] Create snapshot completed successfully Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['2fde0ac7-63c4-459d-b8cb-b3228a833333', '3464406f-1f7a-4ae7-8bf1-360a3a6610fe', '321f553e-1b29-4e11-94f0-cccd63d62ec2', 'd2a76d25-dc86-4269-8b33-9b46f7b8e985'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:25 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:25 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:25 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.326s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleted volume successfully. Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a23d4772-041f-40b2-9424-ec4d1a364890 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-068a2d2b-4534-4d17-be19-e0da9c3dd938-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Flow 'volume_create_manager' (e09d7ae3-1896-408f-9cb9-098204d1c18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcaaa16-c87e-4840-8a7b-a42c5c921056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffcaaa16-c87e-4840-8a7b-a42c5c921056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-478076205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d1880747aa4a7d8c856e8a92885d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:26Z,use_quota=True,user_id='a49ac27b6c6347e080becddf2cd9fa52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3789e4-5b24-429e-b3ee-e79a68715130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3789e4-5b24-429e-b3ee-e79a68715130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d9cda4-abf0-467d-917c-9282561f393d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:25 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (45e99e08-3a35-4bbe-a2f8-824f2c758ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02214b1e-f1ae-4d70-9f3f-1e35cdef9938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02214b1e-f1ae-4d70-9f3f-1e35cdef9938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-302638406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72df9298-1b22-424f-b27a-0b375e3c7775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='791f065b0920439da745b07215fba948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39eff402-9e02-4106-a9d3-07f862a46687,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:26Z,use_quota=True,user_id='807cb80f1e3443e5841f55fbca14ef48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62d622c-8903-4225-ac05-e5a7b31e4f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62d622c-8903-4225-ac05-e5a7b31e4f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae68544-3e7d-4c5d-b3c9-6609880364f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae68544-3e7d-4c5d-b3c9-6609880364f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72df9298-1b22-424f-b27a-0b375e3c7775', 'volume_name': 'volume-72df9298-1b22-424f-b27a-0b375e3c7775', 'volume_size': 1, 'snapshot_id': '39eff402-9e02-4106-a9d3-07f862a46687'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152f9f6-63b2-4918-83c3-119f66b62bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a152f9f6-63b2-4918-83c3-119f66b62bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc72a2-0a60-41f0-ac69-374e62a439a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Volume 72df9298-1b22-424f-b27a-0b375e3c7775: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72df9298-1b22-424f-b27a-0b375e3c7775', 'volume_size': 1, 'snapshot_id': '39eff402-9e02-4106-a9d3-07f862a46687'} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687-72df9298-1b22-424f-b27a-0b375e3c7775" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687-72df9298-1b22-424f-b27a-0b375e3c7775" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Creating volume 72df9298-1b22-424f-b27a-0b375e3c7775 from snapshot 39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] snapshot: 39eff402-9e02-4106-a9d3-07f862a46687, volume: 72df9298-1b22-424f-b27a-0b375e3c7775, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[69819eeb-f709-4937-9f52-5aa322c8a74b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-b696cff1-b477-493e-ac0d-571bebeb4be0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-b696cff1-b477-493e-ac0d-571bebeb4be0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:26 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:26 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b563fc9-e8b4-4ee4-9016-1a0e0b37b769]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:26 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 Aug 03 09:00:26 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d9cda4-abf0-467d-917c-9282561f393d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'volume_name': 'volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e7c32-c092-460e-a566-a13262f785e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746e7c32-c092-460e-a566-a13262f785e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaa5d7d-8426-4cd2-88d9-40467191f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Trying to clone 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.491s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bfc466-f304-4ef6-98b6-965c12bcce2d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:26 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:26 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:27 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0" returned: 0 in 0.553s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:27 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0 Aug 03 09:00:27 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:00:27 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Image download 20.69 MB at 20.69 MB/s Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d813e2-cbd9-401c-b1ff-d2b152201e42]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:27 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.533s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:27 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 Aug 03 09:00:27 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:27 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD Aug 03 09:00:27 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:27 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b696cff1-b477-493e-ac0d-571bebeb4be0" returned: 0 in 0.522s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-b696cff1-b477-493e-ac0d-571bebeb4be0" released by "delete_volume" :: held 1.137s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['c4a78c63-e2ca-42fd-be82-ecec3e98a6ce', 'e58c47fc-cec0-4515-8233-fcf3e0f2c944', 'fae833e0-710d-4eda-bc3f-1523b5a45fe2', 'da151b79-1f79-48be-b68b-df86bff23c99'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:27 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user a49ac27b6c6347e080becddf2cd9fa52. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:00:27 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:27 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aa30b6-1306-4f0c-be76-8df7f12fa4f6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:28 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD Aug 03 09:00:28 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:28 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.520s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:28 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleted volume successfully. Aug 03 09:00:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7da893db-98ef-49d7-9e52-318a46f73d76 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-b696cff1-b477-493e-ac0d-571bebeb4be0-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:29 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD" returned: 0 in 1.155s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-3afc838f-7c3c-4165-ba25-0079d88dbfa2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-3afc838f-7c3c-4165-ba25-0079d88dbfa2-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" acquired by "delete_volume" :: waited 0.034s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4fa8d8-4022-4be1-83ec-fbdd3381a496]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:29 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 Aug 03 09:00:29 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:30 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2" returned: 0 in 0.776s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:30 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2 Aug 03 09:00:30 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:30 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3afc838f-7c3c-4165-ba25-0079d88dbfa2" returned: 0 in 0.563s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-3afc838f-7c3c-4165-ba25-0079d88dbfa2" released by "delete_volume" :: held 1.455s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['ceb29c1e-99c3-4c0e-b32f-440d58dd8229', '13c78cd7-81da-47d5-804e-b3c4f207541e', '54cfdd1e-d7f8-475f-ad5d-73c1dff24a35', 'f461e4bf-611b-44c1-9911-169bc5c31b7d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:31 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:31 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-f57b4d00-a7bd-4226-af9d-d68b0472a341-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-f57b4d00-a7bd-4226-af9d-d68b0472a341-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" acquired by "delete_snapshot" :: waited 0.077s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:32 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting offline snapshot f57b4d00-a7bd-4226-af9d-d68b0472a341 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot_file for this snap is: volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.687s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleted volume successfully. Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[24140f7b-a2ef-44a6-8cba-2c9c59f65fa4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-14af439f-97b9-4dee-a434-a51071542497 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-3afc838f-7c3c-4165-ba25-0079d88dbfa2-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:32 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 09:00:32 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:32 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.620s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ec4bf-26b8-4fa8-b566-827368275a4c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:33 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 09:00:33 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:33 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775" returned: 0 in 6.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:00:33 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Converted 1024.00 MB image at 158.58 MB/s Aug 03 09:00:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 is being set with open permissions: ugo+rw Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:33 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 Aug 03 09:00:33 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:33 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.939s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:33 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 09:00:33 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:34 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775" returned: 0 in 0.287s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" released by "_copy_volume_from_snapshot" :: held 7.882s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687-72df9298-1b22-424f-b27a-0b375e3c7775" released by "_create_volume_from_snapshot" :: held 7.966s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.057s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-478076205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d1880747aa4a7d8c856e8a92885d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:26Z,use_quota=True,user_id='a49ac27b6c6347e080becddf2cd9fa52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Creating volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:34 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:34 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1073741824 Aug 03 09:00:34 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc72a2-0a60-41f0-ac69-374e62a439a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72df9298-1b22-424f-b27a-0b375e3c7775', 'volume_size': 1, 'snapshot_id': '39eff402-9e02-4106-a9d3-07f862a46687'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef4936f-0da7-4087-8086-9e62eac10cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Volume volume-72df9298-1b22-424f-b27a-0b375e3c7775 (72df9298-1b22-424f-b27a-0b375e3c7775): created successfully Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef4936f-0da7-4087-8086-9e62eac10cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Flow 'volume_create_manager' (45e99e08-3a35-4bbe-a2f8-824f2c758ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5d4b3a69-a4a9-4166-aeac-6a8a714a803d tempest-VolumesSnapshotTestJSON-1972819711 None] Created volume successfully. Aug 03 09:00:34 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.736s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:34 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341 Aug 03 09:00:34 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:34 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1073741824" returned: 0 in 0.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:34 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 Aug 03 09:00:34 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:34 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.f57b4d00-a7bd-4226-af9d-d68b0472a341" returned: 0 in 0.297s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-f57b4d00-a7bd-4226-af9d-d68b0472a341" released by "_delete_snapshot" :: held 2.837s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" released by "delete_snapshot" :: held 2.889s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:34 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['2a57b09d-43ae-4ee6-be27-cbb62b61d3ac', 'd3b7b99f-9418-453b-ba5b-fbbe7f5bf33f', '4a006342-9c7c-43d0-aa13-580707a88c0a', '8a84a776-cd39-42e9-9fac-c06dfb64d728'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-72df9298-1b22-424f-b27a-0b375e3c7775-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-72df9298-1b22-424f-b27a-0b375e3c7775-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2874ccd7-06c1-4809-b85a-c086840fb98e]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Delete snapshot completed successfully. Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-caa4215f-e394-4a69-91c4-8698c684ea55 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-f57b4d00-a7bd-4226-af9d-d68b0472a341-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[55442025-d738-4dad-89ce-8548860bcb25]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:35 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu Aug 03 09:00:35 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:35 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 Aug 03 09:00:35 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting offline snapshot 6ad4bc5d-72fe-4e57-a4b5-518f9711e554 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot_file for this snap is: volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2f55b4-e175-463f-a669-0677c95e3cac]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:35 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 09:00:35 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:35 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu" returned: 0 in 0.489s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:35 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu Aug 03 09:00:35 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:35 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775" returned: 0 in 0.507s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:35 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775 Aug 03 09:00:35 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:35 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.452s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1f8726-dc18-4abc-a11f-a7dae5ecade0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:36 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu" returned: 1 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7_9ex0hu' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20db0d3-fb92-47f5-8032-9f1c910bf9a1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:36 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-72df9298-1b22-424f-b27a-0b375e3c7775" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:36 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 09:00:36 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-72df9298-1b22-424f-b27a-0b375e3c7775" released by "delete_volume" :: held 0.919s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['c9fe0198-cc1f-40b9-bb4b-8b8292a2c51f', '90ec795c-cadb-4ed5-8fd4-1ff587ecbec9', 'a84c418b-3906-496f-affc-a50ae9f156ef', '183304ec-3ad5-4618-932c-ccc7dbd4abdc'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:36 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD Aug 03 09:00:36 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:36 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:36 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:36 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.508s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:36 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:00:36 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 09:00:36 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:36 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 Aug 03 09:00:36 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:36 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.351s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleted volume successfully. Aug 03 09:00:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-777c30d8-9085-41e3-b0fb-82e14b5a2d75 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-72df9298-1b22-424f-b27a-0b375e3c7775-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:36 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.519s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:37 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554 Aug 03 09:00:37 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:37 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.6ad4bc5d-72fe-4e57-a4b5-518f9711e554" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-6ad4bc5d-72fe-4e57-a4b5-518f9711e554" released by "_delete_snapshot" :: held 1.888s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" released by "delete_snapshot" :: held 1.937s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['dbeaf11a-eb8a-426a-91b1-881426ff4aa1', '0033c6b7-2070-45f4-8702-d126cfa5df46', '405a3bbf-d2c3-4278-b0a9-84189632bc60', 'b31d0898-299e-4f20-ad64-19530fbc23f0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-39eff402-9e02-4106-a9d3-07f862a46687-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-39eff402-9e02-4106-a9d3-07f862a46687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-7bc70f25-b173-49b5-ac02-9c82b7085f41-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Delete snapshot completed successfully. Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d68aca7-7ae2-4bbd-b270-98a33a9ca6cc tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-6ad4bc5d-72fe-4e57-a4b5-518f9711e554-delete_snapshot" released by "delete_snapshot" :: held 2.275s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleting offline snapshot 39eff402-9e02-4106-a9d3-07f862a46687 of volume 568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] snapshot_file for this snap is: volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-7bc70f25-b173-49b5-ac02-9c82b7085f41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a37da3-35a2-4954-9014-f3d03377845f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleting offline snapshot 7bc70f25-b173-49b5-ac02-9c82b7085f41 of volume 7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] snapshot_file for this snap is: volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0526f65-99c9-4a27-a5e0-2fcb669b4e6e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:37 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:37 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:37 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 09:00:37 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:38 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.487s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49815f6-8ae8-401a-b2d4-ad227db2b8d2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:38 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.508s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7036d96e-5fb9-4bb4-a28c-6a568020f148(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f48b6-5213-4d00-bb70-821cc9aab13e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:38 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:38 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:38 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 09:00:38 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:38 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" returned: 0 in 2.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_w9cazeridevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:00:38 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Converted 112.00 MB image at 48.04 MB/s Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:38 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1G Aug 03 09:00:38 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:38 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.563s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:38 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 09:00:38 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:39 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.818s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:39 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:39 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:39 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 1G" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user a49ac27b6c6347e080becddf2cd9fa52 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Marking volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Creating volume glance metadata for volume 6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edaa5d7d-8426-4cd2-88d9-40467191f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec57a1a3-b039-41da-8dcc-ffd15fa36bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:39 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.541s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:39 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Volume volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 (6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366): created successfully Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec57a1a3-b039-41da-8dcc-ffd15fa36bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Flow 'volume_create_manager' (e09d7ae3-1896-408f-9cb9-098204d1c18b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:39 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41 Aug 03 09:00:39 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1dba6907-1690-4c69-b5ca-81787b5e165a tempest-TestShelveInstance-2057113503 None] Created volume successfully. Aug 03 09:00:39 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687 Aug 03 09:00:39 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:39 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148.7bc70f25-b173-49b5-ac02-9c82b7085f41" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7bc70f25-b173-49b5-ac02-9c82b7085f41" released by "_delete_snapshot" :: held 2.091s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" released by "delete_snapshot" :: held 2.140s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:39 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43.39eff402-9e02-4106-a9d3-07f862a46687" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-39eff402-9e02-4106-a9d3-07f862a46687" released by "_delete_snapshot" :: held 2.276s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" released by "delete_snapshot" :: held 2.348s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['9d581be2-e5bd-4fb1-a179-84f2cd9f700c', '735b0ff3-b36d-4682-a5c2-250bbeeffbf2', '854338dc-7c19-4864-a1f8-5d2dc34292e2', 'cd978f79-6a4a-44cb-ba20-faf4779b4b71'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['632c16a9-4a4e-456b-9ea9-45b1c625235c', '894dca99-dd3f-48ce-b815-eb72b08047fb', 'a0cfd187-c435-4d79-b4e8-bd222f82c80d', '608ee0d9-a715-4be9-88ef-7d1224d818a4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Delete snapshot completed successfully. Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5df399d-c847-4f25-a4a7-77c485642fc5 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-7bc70f25-b173-49b5-ac02-9c82b7085f41-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Delete snapshot completed successfully. Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-062cc2e6-6057-4703-b3a9-b142f9570522 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-39eff402-9e02-4106-a9d3-07f862a46687-delete_snapshot" released by "delete_snapshot" :: held 2.553s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-568a77d0-e1f0-4ef6-b99a-09d84ea78f43-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-568a77d0-e1f0-4ef6-b99a-09d84ea78f43-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-7036d96e-5fb9-4bb4-a28c-6a568020f148-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-7036d96e-5fb9-4bb4-a28c-6a568020f148-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaf7155-d44a-4084-99b1-733ee9325e92]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:41 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:41 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e362f18e-2505-4360-8f4d-1961ef0f480e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:41 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 09:00:41 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:41 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:41 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43 Aug 03 09:00:41 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:41 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.496s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:41 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148 Aug 03 09:00:41 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:42 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" returned: 0 in 0.405s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-568a77d0-e1f0-4ef6-b99a-09d84ea78f43" released by "delete_volume" :: held 1.039s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:42 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7036d96e-5fb9-4bb4-a28c-6a568020f148" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-quobyte-7036d96e-5fb9-4bb4-a28c-6a568020f148" released by "delete_volume" :: held 0.938s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['057b5534-64d5-45cc-a5ea-45a6064a86ba', 'fef2a055-4323-4b2f-86ce-db8144cfd28b', 'f62c4b53-3a5a-48eb-9ca6-8ddac0f13b9e', '7f25bc3f-096b-444d-adfd-e846e4632967'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Created reservations ['7a99930c-9d1e-404b-b547-96b782167f4d', '11ae00ff-1cf4-478b-abcf-7018dbc90ef5', 'ed2d8465-23d3-44d6-93e1-b4bbe426c8b6', '2b2e87cc-4b45-4fcd-92d0-c143f633f36f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:42 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:42 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:42 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:42 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:42 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Deleted volume successfully. Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53ef3280-e35d-47b5-9963-f41b82910a01 tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-568a77d0-e1f0-4ef6-b99a-09d84ea78f43-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:42 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Deleted volume successfully. Aug 03 09:00:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9dc7b78e-21c5-4c94-a454-ff16ac778881 tempest-SnapshotDataIntegrityTests-1209494324 None] Lock "cinder-7036d96e-5fb9-4bb4-a28c-6a568020f148-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-9cc038b0-58e7-4cda-8399-cabeff1df5ef-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-9cc038b0-58e7-4cda-8399-cabeff1df5ef-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" acquired by "delete_volume" :: waited 0.050s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[229a049f-66e8-49fb-bc68-6b355ad50434]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:43 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef Aug 03 09:00:43 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:44 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef" returned: 0 in 0.681s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:44 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef Aug 03 09:00:44 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-631ea211-5a32-4262-a546-b8273121ee17 req-ee68343d-248b-4489-929a-2808c1f3c7b7 tempest-TestShelveInstance-2057113503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-631ea211-5a32-4262-a546-b8273121ee17 req-ee68343d-248b-4489-929a-2808c1f3c7b7 tempest-TestShelveInstance-2057113503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-631ea211-5a32-4262-a546-b8273121ee17 req-ee68343d-248b-4489-929a-2808c1f3c7b7 tempest-TestShelveInstance-2057113503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (8dc8ee4a-3ac5-4b40-844f-d9129587b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d5808-9f3d-4afe-a62d-1efb52d8159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-631ea211-5a32-4262-a546-b8273121ee17 req-ee68343d-248b-4489-929a-2808c1f3c7b7 tempest-TestShelveInstance-2057113503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5e733ed-0bd1-4b34-a1f0-d165547ca2d4', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:00:44 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14d5808-9f3d-4afe-a62d-1efb52d8159c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-504211926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db7cf51-3b16-42bc-a096-428d122b7368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:45Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b229e2-ff7a-433a-a5c4-6b4433543434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b229e2-ff7a-433a-a5c4-6b4433543434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3756afb-463a-45e9-ae1c-b2f8c53bfdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3756afb-463a-45e9-ae1c-b2f8c53bfdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db7cf51-3b16-42bc-a096-428d122b7368', 'volume_name': 'volume-6db7cf51-3b16-42bc-a096-428d122b7368', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dc1393-04a7-4167-b48a-995ba491032e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07dc1393-04a7-4167-b48a-995ba491032e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d72d7ee-26b3-4592-97ef-1a10f56765a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Volume 6db7cf51-3b16-42bc-a096-428d122b7368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db7cf51-3b16-42bc-a096-428d122b7368', 'volume_size': 1} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-504211926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db7cf51-3b16-42bc-a096-428d122b7368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:45Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Creating volume 6db7cf51-3b16-42bc-a096-428d122b7368 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:44 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9cc038b0-58e7-4cda-8399-cabeff1df5ef" returned: 0 in 0.638s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:44 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 1073741824 Aug 03 09:00:44 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-quobyte-9cc038b0-58e7-4cda-8399-cabeff1df5ef" released by "delete_volume" :: held 1.453s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-631ea211-5a32-4262-a546-b8273121ee17 req-ee68343d-248b-4489-929a-2808c1f3c7b7 tempest-TestShelveInstance-2057113503 None] attachment_update completed successfully. Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Created reservations ['48f9e63b-1e59-4da7-9ca1-913f6208f1e1', 'f00eed9f-183f-4212-84a0-757956327f99', '12bc2f1d-288f-4022-bdf2-bb99b1f4f393', '4bf40f8f-f693-4378-bdd9-71a603f382f5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:45 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:45 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:45 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 1073741824" returned: 0 in 0.807s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:45 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 Aug 03 09:00:45 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:45 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.616s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Deleted volume successfully. Aug 03 09:00:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8fe387ca-a7d9-43d4-95f9-f0e1e4af1a7f tempest-VolumesSnapshotTestJSON-1972819711 None] Lock "cinder-9cc038b0-58e7-4cda-8399-cabeff1df5ef-delete_volume" released by "delete_volume" :: held 2.607s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:46 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368" returned: 0 in 0.339s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d72d7ee-26b3-4592-97ef-1a10f56765a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db7cf51-3b16-42bc-a096-428d122b7368', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa25797b-02c6-49e9-bd48-068a507ebe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Volume volume-6db7cf51-3b16-42bc-a096-428d122b7368 (6db7cf51-3b16-42bc-a096-428d122b7368): created successfully Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa25797b-02c6-49e9-bd48-068a507ebe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (8dc8ee4a-3ac5-4b40-844f-d9129587b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-62545fca-2d09-470a-b113-9dd8362eac08 tempest-VolumesListAdminTestJSON-1705771211 None] Created volume successfully. Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (5b2896da-7aef-4150-9213-f5c528048059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efd5c46-bc05-4168-b535-4be7b8642a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efd5c46-bc05-4168-b535-4be7b8642a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-762838165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00761db8-0f60-4ac7-85b7-82a47328ab2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:48Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef1acc-c8a9-4081-b78c-866dc613a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eef1acc-c8a9-4081-b78c-866dc613a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3feb5-345a-4f84-a07e-3c6ac38074d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b3feb5-345a-4f84-a07e-3c6ac38074d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00761db8-0f60-4ac7-85b7-82a47328ab2c', 'volume_name': 'volume-00761db8-0f60-4ac7-85b7-82a47328ab2c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc32b20b-aadf-4b21-a1ee-5b03fa27242f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc32b20b-aadf-4b21-a1ee-5b03fa27242f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3d5d9-9da8-4f34-99f9-1fa95e52aff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Volume 00761db8-0f60-4ac7-85b7-82a47328ab2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00761db8-0f60-4ac7-85b7-82a47328ab2c', 'volume_size': 1} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-762838165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00761db8-0f60-4ac7-85b7-82a47328ab2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:48Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Creating volume 00761db8-0f60-4ac7-85b7-82a47328ab2c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:47 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:47 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c 1073741824 Aug 03 09:00:47 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:48 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c 1073741824" returned: 0 in 0.610s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:48 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c Aug 03 09:00:48 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:48 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bd3d5d9-9da8-4f34-99f9-1fa95e52aff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00761db8-0f60-4ac7-85b7-82a47328ab2c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb681b-a2f0-4ed3-83fe-6f5bc082eee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Volume volume-00761db8-0f60-4ac7-85b7-82a47328ab2c (00761db8-0f60-4ac7-85b7-82a47328ab2c): created successfully Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2feb681b-a2f0-4ed3-83fe-6f5bc082eee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (5b2896da-7aef-4150-9213-f5c528048059) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ce48310f-a95d-4684-b477-c5001878935e tempest-VolumesListAdminTestJSON-1705771211 None] Created volume successfully. Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (5f35f8a4-dfd4-4169-b4cb-ef7d4816a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c83387-0d03-45e8-8804-2679224851a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c83387-0d03-45e8-8804-2679224851a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944465601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8940ae-7d4b-42a3-8bd4-659fda341566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:51Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05ebb68-5a8a-4d62-984e-919d021e9e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05ebb68-5a8a-4d62-984e-919d021e9e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ec8e8a-3a14-4885-8272-164d2cc1f337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ec8e8a-3a14-4885-8272-164d2cc1f337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8940ae-7d4b-42a3-8bd4-659fda341566', 'volume_name': 'volume-7b8940ae-7d4b-42a3-8bd4-659fda341566', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224d722a-f40c-42e9-a053-d41b166f496b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (224d722a-f40c-42e9-a053-d41b166f496b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9485664-a586-4a88-8fcf-a143365d544f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Volume 7b8940ae-7d4b-42a3-8bd4-659fda341566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8940ae-7d4b-42a3-8bd4-659fda341566', 'volume_size': 1} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1944465601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b8940ae-7d4b-42a3-8bd4-659fda341566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0a934c411b42bca5d117db146b3e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:51Z,use_quota=True,user_id='381cc7c2e1f34d569de4974b3e921b22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Creating volume 7b8940ae-7d4b-42a3-8bd4-659fda341566 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:50 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:50 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 1073741824 Aug 03 09:00:50 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:51 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 1073741824" returned: 0 in 0.755s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:51 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 Aug 03 09:00:51 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:52 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9485664-a586-4a88-8fcf-a143365d544f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8940ae-7d4b-42a3-8bd4-659fda341566', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81c35fc-e126-4f96-9b69-df62cbac7ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Volume volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 (7b8940ae-7d4b-42a3-8bd4-659fda341566): created successfully Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81c35fc-e126-4f96-9b69-df62cbac7ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Flow 'volume_create_manager' (5f35f8a4-dfd4-4169-b4cb-ef7d4816a40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1a2a24a1-20e2-4c63-aea8-f9a3025e5ff9 tempest-VolumesListAdminTestJSON-1705771211 None] Created volume successfully. Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Flow 'volume_create_manager' (5c1d561a-52f2-4138-be6e-b699779b771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314ae64-6dcb-433d-af1e-356ef9faca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e314ae64-6dcb-433d-af1e-356ef9faca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53516900-a88d-4b34-9f1d-9153d882adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0948c7b1c54b6797f70a6ee0489eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:54Z,use_quota=True,user_id='c760e697ace34611894fdfddf05c073e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ac1ecb-f786-451d-9ff3-7cbdd41601e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86ac1ecb-f786-451d-9ff3-7cbdd41601e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d1549e-262c-4df5-951f-1527f5f54991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d1549e-262c-4df5-951f-1527f5f54991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53516900-a88d-4b34-9f1d-9153d882adbf', 'volume_name': 'volume-53516900-a88d-4b34-9f1d-9153d882adbf', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503a450-9293-4af3-aa17-e691b518184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e503a450-9293-4af3-aa17-e691b518184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3cd61e-853b-4afd-8278-716e63ceee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Volume 53516900-a88d-4b34-9f1d-9153d882adbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53516900-a88d-4b34-9f1d-9153d882adbf', 'volume_size': 1} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53516900-a88d-4b34-9f1d-9153d882adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0948c7b1c54b6797f70a6ee0489eb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:54Z,use_quota=True,user_id='c760e697ace34611894fdfddf05c073e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Creating volume 53516900-a88d-4b34-9f1d-9153d882adbf {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:54 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:54 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf 1073741824 Aug 03 09:00:54 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:55 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf 1073741824" returned: 0 in 0.948s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:55 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf Aug 03 09:00:55 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:55 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3cd61e-853b-4afd-8278-716e63ceee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53516900-a88d-4b34-9f1d-9153d882adbf', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac5ffde-3978-4d22-96a0-2ed4a15c3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:55 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Volume volume-53516900-a88d-4b34-9f1d-9153d882adbf (53516900-a88d-4b34-9f1d-9153d882adbf): created successfully Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac5ffde-3978-4d22-96a0-2ed4a15c3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Flow 'volume_create_manager' (5c1d561a-52f2-4138-be6e-b699779b771d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-75a73eb4-6de0-445a-8fb8-d1a79338617b tempest-VolumesListAdminTestJSON-1047253775 None] Created volume successfully. Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Acquiring lock "cinder-53516900-a88d-4b34-9f1d-9153d882adbf-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "cinder-53516900-a88d-4b34-9f1d-9153d882adbf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Acquiring lock "cinder-quobyte-53516900-a88d-4b34-9f1d-9153d882adbf" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "cinder-quobyte-53516900-a88d-4b34-9f1d-9153d882adbf" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[185006b4-2b46-447c-858e-78446284daaa]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-7b8940ae-7d4b-42a3-8bd4-659fda341566-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-7b8940ae-7d4b-42a3-8bd4-659fda341566-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:57 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf Aug 03 09:00:57 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-quobyte-7b8940ae-7d4b-42a3-8bd4-659fda341566" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-7b8940ae-7d4b-42a3-8bd4-659fda341566" acquired by "delete_volume" :: waited 0.067s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[074c6590-32f9-44fc-869d-067c508d0bbf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:57 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf" returned: 0 in 0.617s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:57 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf Aug 03 09:00:57 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:57 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 Aug 03 09:00:57 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:58 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566" returned: 0 in 0.926s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:58 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-53516900-a88d-4b34-9f1d-9153d882adbf" returned: 0 in 0.839s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:58 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566 Aug 03 09:00:58 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "cinder-quobyte-53516900-a88d-4b34-9f1d-9153d882adbf" released by "delete_volume" :: held 1.559s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=143,cinder:UPDATE=153,cinder:INSERT=45,cinder:DELETE=16 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=140,cinder:UPDATE=161,cinder:INSERT=43,cinder:DELETE=6 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Flow 'volume_create_manager' (c73c654b-6498-4b4f-bbaf-913adceb8df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:00:58 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c640da-c9c0-4cdf-81c8-8b7b0ce4130f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7b8940ae-7d4b-42a3-8bd4-659fda341566" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c640da-c9c0-4cdf-81c8-8b7b0ce4130f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-163070400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b66e3bf-e7f7-4674-9548-39638e515c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13090c3e770e4668b36949438db665c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:58Z,use_quota=True,user_id='7f4c9ded989148a59325d8a73b40a82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40cb2c1-c424-48de-a063-05e255f2689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40cb2c1-c424-48de-a063-05e255f2689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc31ad57-b656-4810-88b5-5be2217e6136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc31ad57-b656-4810-88b5-5be2217e6136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b66e3bf-e7f7-4674-9548-39638e515c5a', 'volume_name': 'volume-5b66e3bf-e7f7-4674-9548-39638e515c5a', 'volume_size': 2}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b2e3ad-5959-4db1-8b1d-87542d7dce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b2e3ad-5959-4db1-8b1d-87542d7dce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6c6c66-c8ce-42d0-9065-c1a033337dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:00:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Volume 5b66e3bf-e7f7-4674-9548-39638e515c5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b66e3bf-e7f7-4674-9548-39638e515c5a', 'volume_size': 2} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-163070400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b66e3bf-e7f7-4674-9548-39638e515c5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13090c3e770e4668b36949438db665c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:00:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:00:58Z,use_quota=True,user_id='7f4c9ded989148a59325d8a73b40a82c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Creating volume 5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:00:58 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a 2147483648 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-7b8940ae-7d4b-42a3-8bd4-659fda341566" released by "delete_volume" :: held 1.582s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:58 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a 2147483648 Aug 03 09:00:58 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Created reservations ['9e57f032-7ad0-4f67-a951-5a3dc2fd00e3', '9327e0b2-790d-489a-83ec-146c3405d20c', 'a2121cff-d789-44d9-9c70-f565cebd11a3', '518d5bd3-f09c-411e-9640-544396fe81db'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Created reservations ['5f7ac040-689f-4d44-8a03-7fa54df2d171', 'ee6efcf1-f829-4237-a53e-7e305ec41834', '6cce15b3-9856-4bab-8aa5-ae87dfcb1ea6', 'eab11f20-1301-4726-ac4b-46934fa3a937'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:59 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:59 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:00:59 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:00:59 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:00:59 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.620s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Deleted volume successfully. Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3de9cfa8-f829-4855-97f8-688dd4f947f4 tempest-VolumesListAdminTestJSON-1047253775 None] Lock "cinder-53516900-a88d-4b34-9f1d-9153d882adbf-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-00761db8-0f60-4ac7-85b7-82a47328ab2c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-00761db8-0f60-4ac7-85b7-82a47328ab2c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:00:59 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.694s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:00:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Deleted volume successfully. Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fb9e470a-59ac-4866-b6e2-bfb8b77e2c3c tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-7b8940ae-7d4b-42a3-8bd4-659fda341566-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-quobyte-00761db8-0f60-4ac7-85b7-82a47328ab2c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:00:59 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a 2147483648" returned: 0 in 1.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:00:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-00761db8-0f60-4ac7-85b7-82a47328ab2c" acquired by "delete_volume" :: waited 0.047s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abc0991-27a5-40ed-a79e-1862c27252a5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:00 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a Aug 03 09:01:00 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:00 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c Aug 03 09:01:00 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:00 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a" returned: 0 in 0.368s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a6c6c66-c8ce-42d0-9065-c1a033337dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b66e3bf-e7f7-4674-9548-39638e515c5a', 'volume_size': 2}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab21a7f-c43e-4155-8082-443addd92e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:00 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Volume volume-5b66e3bf-e7f7-4674-9548-39638e515c5a (5b66e3bf-e7f7-4674-9548-39638e515c5a): created successfully Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ab21a7f-c43e-4155-8082-443addd92e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Flow 'volume_create_manager' (c73c654b-6498-4b4f-bbaf-913adceb8df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1a5d2702-0793-47d8-8261-c340c1adb4b6 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Created volume successfully. Aug 03 09:01:00 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c" returned: 0 in 0.663s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:00 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c Aug 03 09:01:00 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:01 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-00761db8-0f60-4ac7-85b7-82a47328ab2c" returned: 0 in 0.351s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-00761db8-0f60-4ac7-85b7-82a47328ab2c" released by "delete_volume" :: held 1.094s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Created reservations ['fd2e8128-7704-4138-90fe-1e1830967e49', '587b8e84-a9a5-4638-a3d4-2b52ab7f8496', 'bafc1bdd-41b4-4730-8974-101ffd2fa689', '72c0c7f9-2454-4fd0-ab9e-f8d1c86122db'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:01 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:01 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Creating offline snapshot f7a10a32-8183-478d-987c-da9537c5d555 of volume 5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[945906e1-9197-4a2d-ac61-78e6ee567b3a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:01 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.611s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Deleted volume successfully. Aug 03 09:01:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1280b1b5-0613-46fc-a9aa-de957d490c81 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-00761db8-0f60-4ac7-85b7-82a47328ab2c-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:01 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a Aug 03 09:01:01 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-6db7cf51-3b16-42bc-a096-428d122b7368-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-6db7cf51-3b16-42bc-a096-428d122b7368-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "cinder-quobyte-6db7cf51-3b16-42bc-a096-428d122b7368" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-6db7cf51-3b16-42bc-a096-428d122b7368" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b5c84c-42f0-4467-aced-f654e7e26dee]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:02 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a" returned: 0 in 0.722s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 2G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:02 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 2G Aug 03 09:01:02 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:02 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 Aug 03 09:01:02 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:03 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368" returned: 0 in 0.600s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:03 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368 Aug 03 09:01:03 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:03 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 2G" returned: 0 in 0.620s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b66e3bf-e7f7-4674-9548-39638e515c5a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:03 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b66e3bf-e7f7-4674-9548-39638e515c5a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 Aug 03 09:01:03 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:03 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6db7cf51-3b16-42bc-a096-428d122b7368" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-quobyte-6db7cf51-3b16-42bc-a096-428d122b7368" released by "delete_volume" :: held 1.081s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Created reservations ['b3ab468f-75ca-4384-9d1d-6c32c75b7424', 'a8dcee6c-dbbb-4ceb-9ecb-38d000eadb50', '7b0437cf-fc92-4678-900b-cc8081c8d9d1', 'f1f36d5d-bee5-41db-b2d6-783764616177'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:03 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b66e3bf-e7f7-4674-9548-39638e515c5a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555" returned: 0 in 0.579s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:03 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 is being set with open permissions: ugo+rw Aug 03 09:01:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:03 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:03 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:03 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 Aug 03 09:01:03 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:04 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:04 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.424s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Deleted volume successfully. Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-27310dd4-350d-43ec-9692-ac1d4c18fca9 tempest-VolumesListAdminTestJSON-1705771211 None] Lock "cinder-6db7cf51-3b16-42bc-a096-428d122b7368-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:04 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info Aug 03 09:01:04 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:04 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:04 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info is being set with open permissions: ugo+rw Aug 03 09:01:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:04 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info Aug 03 09:01:04 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:05 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.info" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.345s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-40105209-794c-436f-9d52-9e38c2219efe tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Create snapshot completed successfully Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "cinder-f7a10a32-8183-478d-987c-da9537c5d555-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-f7a10a32-8183-478d-987c-da9537c5d555-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "cinder-quobyte-f7a10a32-8183-478d-987c-da9537c5d555" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-f7a10a32-8183-478d-987c-da9537c5d555" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Deleting offline snapshot f7a10a32-8183-478d-987c-da9537c5d555 of volume 5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] snapshot_file for this snap is: volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d369e2b8-c2aa-4d7e-83fc-8628dad07f4c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:06 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 Aug 03 09:01:06 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:06 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555" returned: 0 in 0.591s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b66e3bf-e7f7-4674-9548-39638e515c5a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b393601e-30ed-4538-b62e-7992807e2fea]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:07 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a Aug 03 09:01:07 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:07 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a" returned: 0 in 0.573s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:07 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 Aug 03 09:01:07 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:07 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555" returned: 0 in 0.427s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:08 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555 Aug 03 09:01:08 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:08 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a.f7a10a32-8183-478d-987c-da9537c5d555" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-f7a10a32-8183-478d-987c-da9537c5d555" released by "_delete_snapshot" :: held 2.166s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" released by "delete_snapshot" :: held 2.201s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Created reservations ['8f36bad2-06d4-4580-8ab9-35f4652f0407', 'd3f42bc3-6570-48d9-8ee2-4e1f6aa416c1', 'e75ff1e0-f3a1-4093-b761-3821e8c1d33c', 'cb1ff993-4936-46d9-9cd4-dfa90177499d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Delete snapshot completed successfully. Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ab4572f6-036b-4b5d-a6b7-a77aac222ea9 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-f7a10a32-8183-478d-987c-da9537c5d555-delete_snapshot" released by "delete_snapshot" :: held 2.400s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:08 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:08 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:09 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "cinder-5b66e3bf-e7f7-4674-9548-39638e515c5a-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-5b66e3bf-e7f7-4674-9548-39638e515c5a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5c5e89-1668-47df-854c-ad1f5b9c40a1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:09 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a Aug 03 09:01:09 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:10 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:10 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a Aug 03 09:01:10 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:10 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5b66e3bf-e7f7-4674-9548-39638e515c5a" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-quobyte-5b66e3bf-e7f7-4674-9548-39638e515c5a" released by "delete_volume" :: held 0.793s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Created reservations ['ed8bf244-daf2-4247-a637-81825a285c56', '0dbc37cd-a647-459b-ad77-d4835a2f4919', '9fcb4732-0861-4d82-a653-2d54b235fee8', 'c4513f7b-d8ae-44ae-b435-5c23f5665902'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:10 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:10 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Flow 'volume_create_manager' (52d18b0d-b09c-4e04-8db0-dfb0dda7ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f9f49c-b7cc-4e97-9311-d1274c5c21ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f9f49c-b7cc-4e97-9311-d1274c5c21ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-564540890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3e5169-372e-4c24-bcd5-350932f77eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685818a943154694bfc6ef8e0e4d03ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:11Z,use_quota=True,user_id='917f200c385d420c96d8ba6c265f843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b21f4d-3cbc-4d79-a5e8-e1635078e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b21f4d-3cbc-4d79-a5e8-e1635078e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aabb974-083b-4b20-b5b1-3f0fb985dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:01:10 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Deleted volume successfully. Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-687718f6-b150-4ef5-a174-03492622ff55 tempest-VolumesSnapshotNegativeTestJSON-1010962370 None] Lock "cinder-5b66e3bf-e7f7-4674-9548-39638e515c5a-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aabb974-083b-4b20-b5b1-3f0fb985dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae3e5169-372e-4c24-bcd5-350932f77eea', 'volume_name': 'volume-ae3e5169-372e-4c24-bcd5-350932f77eea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ad6416-9408-47c0-84ba-6d5897d5aed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ad6416-9408-47c0-84ba-6d5897d5aed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cd8ff2-ad6e-4cb9-9836-60372a16a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Volume ae3e5169-372e-4c24-bcd5-350932f77eea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae3e5169-372e-4c24-bcd5-350932f77eea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Trying to clone ae3e5169-372e-4c24-bcd5-350932f77eea from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:01:11 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Image download 20.69 MB at 20.69 MB/s Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e5eb5c-c17d-4d0c-972e-77f4d6139385]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:11 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD Aug 03 09:01:11 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:11 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user 917f200c385d420c96d8ba6c265f843b. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[21983ae3-bcb8-403d-a374-c8c9befe33b1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:12 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD Aug 03 09:01:12 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:12 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-564540890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3e5169-372e-4c24-bcd5-350932f77eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='685818a943154694bfc6ef8e0e4d03ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:11Z,use_quota=True,user_id='917f200c385d420c96d8ba6c265f843b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Creating volume ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:12 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:12 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1073741824 Aug 03 09:01:12 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:12 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1073741824" returned: 0 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:12 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea Aug 03 09:01:12 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:13 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume ae3e5169-372e-4c24-bcd5-350932f77eea. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdd830f-243e-4607-b9f3-c86dd7498abe]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:13 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj Aug 03 09:01:13 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:13 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj" returned: 0 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:13 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj Aug 03 09:01:13 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:13 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj" returned: 1 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_0w2dvqcj' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13d90c7-4ba7-4bcc-8224-a0d6cc139a5f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:13 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD Aug 03 09:01:13 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:14 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:01:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:14 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea Aug 03 09:01:14 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:15 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea" returned: 0 in 1.747s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:15 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_rhrvuoapdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:01:15 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Converted 112.00 MB image at 64.07 MB/s Aug 03 09:01:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:16 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1G Aug 03 09:01:16 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:16 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea 1G" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume ae3e5169-372e-4c24-bcd5-350932f77eea successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user 917f200c385d420c96d8ba6c265f843b is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Marking volume ae3e5169-372e-4c24-bcd5-350932f77eea as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to ae3e5169-372e-4c24-bcd5-350932f77eea. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Creating volume glance metadata for volume ae3e5169-372e-4c24-bcd5-350932f77eea backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64cd8ff2-ad6e-4cb9-9836-60372a16a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3e5169-372e-4c24-bcd5-350932f77eea', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c2a295-b976-46b5-b96e-e36f2e4784ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Volume volume-ae3e5169-372e-4c24-bcd5-350932f77eea (ae3e5169-372e-4c24-bcd5-350932f77eea): created successfully Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c2a295-b976-46b5-b96e-e36f2e4784ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Flow 'volume_create_manager' (52d18b0d-b09c-4e04-8db0-dfb0dda7ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-adb35cd7-7d0e-4c7b-97cc-e7f412b7dd30 tempest-VolumesImageMetadata-1304368121 None] Created volume successfully. Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Acquiring lock "cinder-ae3e5169-372e-4c24-bcd5-350932f77eea-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "cinder-ae3e5169-372e-4c24-bcd5-350932f77eea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Acquiring lock "cinder-quobyte-ae3e5169-372e-4c24-bcd5-350932f77eea" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "cinder-quobyte-ae3e5169-372e-4c24-bcd5-350932f77eea" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5fd0c1-e303-4012-abc6-b6a62529037e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:17 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea Aug 03 09:01:17 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:17 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea" returned: 0 in 0.536s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:18 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea Aug 03 09:01:18 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:18 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ae3e5169-372e-4c24-bcd5-350932f77eea" returned: 0 in 0.289s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "cinder-quobyte-ae3e5169-372e-4c24-bcd5-350932f77eea" released by "delete_volume" :: held 0.883s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Created reservations ['6d371e3a-3ff5-4a20-8d8c-ef504c3b86c2', '567641e2-3650-4da9-9d77-51055431bf73', 'f01b8c66-c510-4b32-b7fb-4dec7d12a8b8', 'c8eede44-4760-4b4d-a9aa-4812d416d87c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:18 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:18 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:18 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.461s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:18 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Deleted volume successfully. Aug 03 09:01:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c7abc97e-dc5b-46ad-9e2e-722a81a79045 tempest-VolumesImageMetadata-1304368121 None] Lock "cinder-ae3e5169-372e-4c24-bcd5-350932f77eea-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (4badcf33-196e-4850-95d2-874ea8b13ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4051c08-a1df-40cf-a4cc-7d33a7122394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4051c08-a1df-40cf-a4cc-7d33a7122394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1002573498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306fc227-2dba-4d36-815e-35f6ba16bf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8415782629904893a9f6b29cd8b73078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:24Z,use_quota=True,user_id='70036ebca665469081dfa7951f8ff01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584b0817-7401-40d4-b3bd-b62747cc1e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584b0817-7401-40d4-b3bd-b62747cc1e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cadd5a1-5b46-48db-bef4-5a379febec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cadd5a1-5b46-48db-bef4-5a379febec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306fc227-2dba-4d36-815e-35f6ba16bf25', 'volume_name': 'volume-306fc227-2dba-4d36-815e-35f6ba16bf25', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b435a6-000d-426f-85b2-ad055fc91075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b435a6-000d-426f-85b2-ad055fc91075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b869261-0c71-490b-9db0-c8d1c079d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Volume 306fc227-2dba-4d36-815e-35f6ba16bf25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306fc227-2dba-4d36-815e-35f6ba16bf25', 'volume_size': 1} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1002573498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306fc227-2dba-4d36-815e-35f6ba16bf25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8415782629904893a9f6b29cd8b73078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:24Z,use_quota=True,user_id='70036ebca665469081dfa7951f8ff01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Creating volume 306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:23 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:23 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 1073741824 Aug 03 09:01:23 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:24 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 1073741824" returned: 0 in 0.545s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:24 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:24 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:24 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.334s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b869261-0c71-490b-9db0-c8d1c079d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306fc227-2dba-4d36-815e-35f6ba16bf25', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7671c26d-2c1f-4029-9c62-fa39a86ee9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Volume volume-306fc227-2dba-4d36-815e-35f6ba16bf25 (306fc227-2dba-4d36-815e-35f6ba16bf25): created successfully Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7671c26d-2c1f-4029-9c62-fa39a86ee9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (4badcf33-196e-4850-95d2-874ea8b13ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-53964051-c2dc-4f55-bfef-ea040f2bea81 tempest-VolumesDeleteCascade-1973898149 None] Created volume successfully. Aug 03 09:01:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-c39b4ed0-23d8-42ba-999b-29c8fc2cc94b req-20ed1476-a52c-4538-a6b9-9829d8d59920 tempest-TestShelveInstance-2057113503 None] Terminate volume connection completed successfully. Aug 03 09:01:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-c39b4ed0-23d8-42ba-999b-29c8fc2cc94b req-20ed1476-a52c-4538-a6b9-9829d8d59920 tempest-TestShelveInstance-2057113503 None] Deleting attachment e5e733ed-0bd1-4b34-a1f0-d165547ca2d4. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:01:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Creating offline snapshot 2b917954-db0c-4322-abb2-b45689618a0b of volume 306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1605cc-1535-4607-8c8a-f83c8212fafc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:26 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:26 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:26 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:26 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b 1G Aug 03 09:01:26 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:26 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b 1G" returned: 0 in 0.522s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:26 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:26 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:27 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:27 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b is being set with open permissions: ugo+rw Aug 03 09:01:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:27 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:27 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:27 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.325s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:27 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info Aug 03 09:01:27 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:27 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info is being set with open permissions: ugo+rw Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:28 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info Aug 03 09:01:28 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:28 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.info" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.465s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e3950306-f7c3-490b-8cd3-0ba9c154c335 tempest-VolumesDeleteCascade-1973898149 None] Create snapshot completed successfully Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d22f45ca-0fbd-4d88-b75a-42f6036af442 req-b43aba68-3694-4fcc-b5f4-2c8df673bcee tempest-TestShelveInstance-2057113503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d22f45ca-0fbd-4d88-b75a-42f6036af442 req-b43aba68-3694-4fcc-b5f4-2c8df673bcee tempest-TestShelveInstance-2057113503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-d22f45ca-0fbd-4d88-b75a-42f6036af442 req-b43aba68-3694-4fcc-b5f4-2c8df673bcee tempest-TestShelveInstance-2057113503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-d22f45ca-0fbd-4d88-b75a-42f6036af442 req-b43aba68-3694-4fcc-b5f4-2c8df673bcee tempest-TestShelveInstance-2057113503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e61c3f1-fde7-452a-a77c-f6d9e123d78a', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:01:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-d22f45ca-0fbd-4d88-b75a-42f6036af442 req-b43aba68-3694-4fcc-b5f4-2c8df673bcee tempest-TestShelveInstance-2057113503 None] attachment_update completed successfully. Aug 03 09:01:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Creating offline snapshot 2f5400a2-a9ee-415b-868e-d15f0fa67691 of volume 306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:01:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8711265-32e7-425a-b884-f0538fbe0407]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:29 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:29 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:30 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306fc227-2dba-4d36-815e-35f6ba16bf25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:30 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 1G Aug 03 09:01:30 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:30 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 1G" returned: 0 in 0.576s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:30 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:30 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:31 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:31 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 is being set with open permissions: ugo+rw Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:31 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:31 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:31 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.298s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6f7a6909-fc8f-4e7e-b71a-b68f61824a88 tempest-VolumesDeleteCascade-1973898149 None] Create snapshot completed successfully Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-306fc227-2dba-4d36-815e-35f6ba16bf25-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-306fc227-2dba-4d36-815e-35f6ba16bf25-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Performing cascade delete. {{(pid=88796) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-2b917954-db0c-4322-abb2-b45689618a0b-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-2b917954-db0c-4322-abb2-b45689618a0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-2b917954-db0c-4322-abb2-b45689618a0b" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-2b917954-db0c-4322-abb2-b45689618a0b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Deleting offline snapshot 2b917954-db0c-4322-abb2-b45689618a0b of volume 306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] snapshot_file for this snap is: volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[638b21b1-8f76-4b76-8da6-fe46d7681a97]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:32 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:32 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:32 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.501s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306fc227-2dba-4d36-815e-35f6ba16bf25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d297f6-f9e2-4fb2-8902-67005142a087]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:32 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:32 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:32 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.555s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f34bc07-8348-4f2c-ba50-00399bb82fe9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:33 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:33 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:33 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.475s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306fc227-2dba-4d36-815e-35f6ba16bf25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc1008d-1b21-48a9-a984-b415cc02c3b5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:33 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:33 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:34 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.688s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306fc227-2dba-4d36-815e-35f6ba16bf25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4bea92-65c7-426c-b459-ec2d48e96c65]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:34 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:34 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:34 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.560s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:34 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:34 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:35 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.613s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:35 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b Aug 03 09:01:35 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:35 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2b917954-db0c-4322-abb2-b45689618a0b" returned: 0 in 0.318s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 -F qcow2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:35 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 -F qcow2 Aug 03 09:01:35 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:36 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-306fc227-2dba-4d36-815e-35f6ba16bf25 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 -F qcow2" returned: 0 in 0.475s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-2b917954-db0c-4322-abb2-b45689618a0b" released by "_delete_snapshot" :: held 4.440s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" released by "delete_snapshot" :: held 4.465s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['3ac94378-4936-4592-a552-180e71bd7136', '620a8a05-821a-4262-abf5-ce9b81dc1052', '2ddbafea-9886-40a0-a60a-5b4983ca3356', '5d5afa05-8952-4ce8-a45e-3fb41ba6f3a8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Delete snapshot completed successfully. Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-2b917954-db0c-4322-abb2-b45689618a0b-delete_snapshot" released by "delete_snapshot" :: held 4.741s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-2f5400a2-a9ee-415b-868e-d15f0fa67691-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-2f5400a2-a9ee-415b-868e-d15f0fa67691-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-2f5400a2-a9ee-415b-868e-d15f0fa67691" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-2f5400a2-a9ee-415b-868e-d15f0fa67691" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Deleting offline snapshot 2f5400a2-a9ee-415b-868e-d15f0fa67691 of volume 306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] snapshot_file for this snap is: volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f0fe47-e9ff-4d54-b0a4-0f42cec3b418]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:36 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:36 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:37 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.505s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-306fc227-2dba-4d36-815e-35f6ba16bf25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cf20d0-4c80-4004-8e32-dc5e94b4226d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:37 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:37 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:37 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.496s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:37 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:37 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:38 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.458s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:38 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691 Aug 03 09:01:38 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:38 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25.2f5400a2-a9ee-415b-868e-d15f0fa67691" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-2f5400a2-a9ee-415b-868e-d15f0fa67691" released by "_delete_snapshot" :: held 1.994s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" released by "delete_snapshot" :: held 2.041s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['e5777060-b32e-42be-87b0-5c86e35274c0', 'edf8241d-ee29-4362-a5ef-631fecad4ca4', '47beeb6e-7241-4c66-a11d-81c0a268c5ed', '8275b09f-50df-4fbe-8da1-df345029fc14'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Delete snapshot completed successfully. Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-2f5400a2-a9ee-415b-868e-d15f0fa67691-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Snapshots deleted, issuing volume delete {{(pid=88796) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf9f2f5-1744-4878-80aa-7a3de37d2158]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:39 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:39 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:39 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.571s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:39 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25 Aug 03 09:01:39 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:39 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-306fc227-2dba-4d36-815e-35f6ba16bf25" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-306fc227-2dba-4d36-815e-35f6ba16bf25" released by "delete_volume" :: held 0.995s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['33de2bdd-6486-42bd-a2e6-a82164bb3d4b', '1edf8cae-dc15-4961-8607-d304477dbc01', 'cd86f71e-21f0-4ea7-be65-6ab3fdda95a3', '2f87c13d-71f4-4df1-a305-39b05a605827'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:40 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:01:40 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:40 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:40 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:01:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Deleted volume successfully. Aug 03 09:01:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cd76ec57-a035-4d44-acd4-008b7d668d94 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-306fc227-2dba-4d36-815e-35f6ba16bf25-delete_volume" released by "delete_volume" :: held 8.659s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (a05d2683-05a2-44ac-9419-3e1e7574f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88409bcc-850f-4a4c-8459-91718659db44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88409bcc-850f-4a4c-8459-91718659db44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233838929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:41Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c07319fd-8ae9-4f80-b6e5-9a5ad2db5ef6),volume_type_id=c07319fd-8ae9-4f80-b6e5-9a5ad2db5ef6)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c67e82-3acd-4bf3-954f-e1890c07d3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1c67e82-3acd-4bf3-954f-e1890c07d3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edacf0-2fe3-4e75-b399-2f5818077446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77edacf0-2fe3-4e75-b399-2f5818077446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d', 'volume_name': 'volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02941f25-1735-4069-8497-6677217146ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02941f25-1735-4069-8497-6677217146ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb9fe2-815f-4821-9008-ff90f0fd512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume 1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d', 'volume_size': 1} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-233838929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:41Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c07319fd-8ae9-4f80-b6e5-9a5ad2db5ef6),volume_type_id=c07319fd-8ae9-4f80-b6e5-9a5ad2db5ef6)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Creating volume 1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:41 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:41 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d 1073741824 Aug 03 09:01:41 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (0687bfd5-b979-4364-b60e-d5cd363a73f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7815c5b-a0d4-4b0b-b6cb-efa8782149b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:41 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (b51ca30e-3d38-485f-941a-8856da9e75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bc6885-3cd3-4c95-8555-d0016af159ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d 1073741824" returned: 0 in 0.735s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7815c5b-a0d4-4b0b-b6cb-efa8782149b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1968070433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50897a0-c575-4cdb-8ee4-2cec80628c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09edffd8-443e-4c66-bd74-fa5243e6d01a),volume_type_id=09edffd8-443e-4c66-bd74-fa5243e6d01a)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf537b2-e2f4-4e1e-b9c8-b04a6afdf784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf537b2-e2f4-4e1e-b9c8-b04a6afdf784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c59eb2-ff45-4c89-b7ce-f7a2d627b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c59eb2-ff45-4c89-b7ce-f7a2d627b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50897a0-c575-4cdb-8ee4-2cec80628c21', 'volume_name': 'volume-d50897a0-c575-4cdb-8ee4-2cec80628c21', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac89b78-b30f-48ef-8159-9bd7767b932b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bac89b78-b30f-48ef-8159-9bd7767b932b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7d336f-a594-4349-a347-7e4278e89716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume d50897a0-c575-4cdb-8ee4-2cec80628c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50897a0-c575-4cdb-8ee4-2cec80628c21', 'volume_size': 1} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4bc6885-3cd3-4c95-8555-d0016af159ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-858549450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8415782629904893a9f6b29cd8b73078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='70036ebca665469081dfa7951f8ff01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d331a63-6692-4351-9ffb-c3ea1a8f5f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d331a63-6692-4351-9ffb-c3ea1a8f5f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abf95e-e9f6-4972-9bbe-f021494732e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abf95e-e9f6-4972-9bbe-f021494732e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b', 'volume_name': 'volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fbe2ad-c0f8-458b-a044-06c3d3ae7ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93fbe2ad-c0f8-458b-a044-06c3d3ae7ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae43c6d9-160d-4d63-9e39-83f6ee70a272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Volume b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b', 'volume_size': 1} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:42 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d Aug 03 09:01:42 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (46f4b9fc-153e-4efa-8f3b-e6eb8edd3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b879bac6-d5f5-4ac7-9cb8-fe70d9b867f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b879bac6-d5f5-4ac7-9cb8-fe70d9b867f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014406574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff32c00-0007-41e6-93b9-6ef850f1fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e312845d-ddad-4a0a-b6c7-3fe1914e9fe1),volume_type_id=e312845d-ddad-4a0a-b6c7-3fe1914e9fe1)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35366a10-a96e-49d2-b88b-50939f54beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35366a10-a96e-49d2-b88b-50939f54beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc583662-9290-4f87-bbfa-03dcee9e4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:01:42 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" returned: 0 in 0.359s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.479s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1968070433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50897a0-c575-4cdb-8ee4-2cec80628c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09edffd8-443e-4c66-bd74-fa5243e6d01a),volume_type_id=09edffd8-443e-4c66-bd74-fa5243e6d01a)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Creating volume d50897a0-c575-4cdb-8ee4-2cec80628c21 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:42 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 1073741824 Aug 03 09:01:42 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10eb9fe2-815f-4821-9008-ff90f0fd512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bf602e-d0c0-49e0-91b9-768a7f46ab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d (1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d): created successfully Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bf602e-d0c0-49e0-91b9-768a7f46ab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (a05d2683-05a2-44ac-9419-3e1e7574f65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4236cb91-5f3f-487b-aea8-8869179509d9 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created volume successfully. Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc583662-9290-4f87-bbfa-03dcee9e4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4ff32c00-0007-41e6-93b9-6ef850f1fd57', 'volume_name': 'volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57', 'volume_size': 1, 'image_id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1743684102', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '820e48c124b54804a321e98757bc02f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'created_at': datetime.datetime(2026, 8, 3, 7, 1, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f161f10-82e5-47a8-a24a-6ba383d28bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f161f10-82e5-47a8-a24a-6ba383d28bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec47d4fb-3b9c-4b45-bd18-7bacca9118aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57', 'volume_size': 1, 'image_id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1743684102', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '820e48c124b54804a321e98757bc02f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'created_at': datetime.datetime(2026, 8, 3, 7, 1, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb/file', 'properties': {}}, 'image_service': } Aug 03 09:01:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Trying to clone 4ff32c00-0007-41e6-93b9-6ef850f1fd57 from image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:01:43 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 1073741824" returned: 0 in 0.492s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:43 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 Aug 03 09:01:43 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:43 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.254s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-858549450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8415782629904893a9f6b29cd8b73078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='70036ebca665469081dfa7951f8ff01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Creating volume b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:43 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b 1073741824 Aug 03 09:01:43 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7d336f-a594-4349-a347-7e4278e89716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50897a0-c575-4cdb-8ee4-2cec80628c21', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfed1a0f-79a0-42c6-912c-a9d36fda4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 (d50897a0-c575-4cdb-8ee4-2cec80628c21): created successfully Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfed1a0f-79a0-42c6-912c-a9d36fda4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (0687bfd5-b979-4364-b60e-d5cd363a73f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-42bf39c5-1af6-4325-bf5c-711097234d03 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created volume successfully. Aug 03 09:01:43 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b 1073741824" returned: 0 in 0.475s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:43 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:43 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:44 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae43c6d9-160d-4d63-9e39-83f6ee70a272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d28786-ef32-41d1-84ca-6add04c7e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Volume volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b (b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b): created successfully Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d28786-ef32-41d1-84ca-6add04c7e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (b51ca30e-3d38-485f-941a-8856da9e75ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-89330159-c580-465d-9a2d-ff0fb48e1ac9 tempest-VolumesDeleteCascade-1973898149 None] Created volume successfully. Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Creating offline snapshot 8058c28a-83d2-4c77-b0d0-49bffc279211 of volume b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aaa7b7-dee8-4c65-a9c6-acd827029851]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:45 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:45 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:45 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:45 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 1G Aug 03 09:01:45 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:45 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 1G" returned: 0 in 0.535s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:45 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:45 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:46 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.326s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:46 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 is being set with open permissions: ugo+rw Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:46 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:46 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD, size 20.69 MB, duration 3.71 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:01:46 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Image download 20.69 MB at 5.57 MB/s Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c374a35-3d7d-443c-9f58-5b9ad7d0cf72]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:46 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:46 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info Aug 03 09:01:46 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:46 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD Aug 03 09:01:46 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:46 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Temporary image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb is fetched for user 8b9a37b9af85468bb550518881d77746. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:01:46 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:46 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info is being set with open permissions: ugo+rw Aug 03 09:01:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:46 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info Aug 03 09:01:46 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebb29df-d7f9-43b2-8d18-8e1f3c7e6131]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:47 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD Aug 03 09:01:47 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:47 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.info" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b1fcabc8-1ab1-46c3-97c1-4e7896071b6a tempest-VolumesDeleteCascade-1973898149 None] Create snapshot completed successfully Aug 03 09:01:47 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1014406574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ff32c00-0007-41e6-93b9-6ef850f1fd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='820e48c124b54804a321e98757bc02f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:42Z,use_quota=True,user_id='8b9a37b9af85468bb550518881d77746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e312845d-ddad-4a0a-b6c7-3fe1914e9fe1),volume_type_id=e312845d-ddad-4a0a-b6c7-3fe1914e9fe1)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Creating volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:47 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:47 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1073741824 Aug 03 09:01:47 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:47 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1073741824" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:47 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 Aug 03 09:01:47 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:48 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57" returned: 0 in 0.259s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Attempting download of 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb ((None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}])) to volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc994cc-68b0-457c-a440-7395732a9192]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:48 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou Aug 03 09:01:48 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:48 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:48 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou Aug 03 09:01:48 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (1d09e832-27a0-46fb-90bf-b138de17e1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e862155-2d86-4319-80c6-8b8bca03a683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e862155-2d86-4319-80c6-8b8bca03a683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1874437368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8488643f-7421-4fbb-a5f0-0d984f2a7950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8415782629904893a9f6b29cd8b73078',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8058c28a-83d2-4c77-b0d0-49bffc279211,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:01:49Z,use_quota=True,user_id='70036ebca665469081dfa7951f8ff01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698ef525-56b4-40d8-94e5-002aadc0fbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (698ef525-56b4-40d8-94e5-002aadc0fbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a89dca-bd82-42b2-912d-8ad5bfe1311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a89dca-bd82-42b2-912d-8ad5bfe1311a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8488643f-7421-4fbb-a5f0-0d984f2a7950', 'volume_name': 'volume-8488643f-7421-4fbb-a5f0-0d984f2a7950', 'volume_size': 1, 'snapshot_id': '8058c28a-83d2-4c77-b0d0-49bffc279211'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7ecc79-28bc-4f23-b56b-ea3388f0b484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7ecc79-28bc-4f23-b56b-ea3388f0b484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cec713-ce23-43df-b0a6-a3f0ce75ae97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Volume 8488643f-7421-4fbb-a5f0-0d984f2a7950: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8488643f-7421-4fbb-a5f0-0d984f2a7950', 'volume_size': 1, 'snapshot_id': '8058c28a-83d2-4c77-b0d0-49bffc279211'} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211-8488643f-7421-4fbb-a5f0-0d984f2a7950" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211-8488643f-7421-4fbb-a5f0-0d984f2a7950" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Creating volume 8488643f-7421-4fbb-a5f0-0d984f2a7950 from snapshot 8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] snapshot: 8058c28a-83d2-4c77-b0d0-49bffc279211, volume: 8488643f-7421-4fbb-a5f0-0d984f2a7950, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ee2d5-d1ad-444b-b608-3bf46290ff0b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:48 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou" returned: 1 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_4tzrqwou' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a913f0cf-615c-438e-9799-297df66e5704]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:49 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:49 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:49 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD Aug 03 09:01:49 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:49 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:49 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:49 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 Aug 03 09:01:49 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7aafac2-aade-487d-8ece-54eab5ae90ee]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:49 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:49 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:49 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.434s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:01:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:49 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 Aug 03 09:01:49 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:52 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57" returned: 0 in 2.926s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:52 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a292454-dc7b-4576-9d3c-c47c5e3f9bbb_f5uwn647devstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:01:52 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Converted 112.00 MB image at 38.23 MB/s Aug 03 09:01:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:52 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1G Aug 03 09:01:52 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:53 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 1G" returned: 0 in 0.902s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Downloaded image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb ((None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}])) to volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Temporary image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb for user 8b9a37b9af85468bb550518881d77746 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Marking volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Copying metadata from image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb to 4ff32c00-0007-41e6-93b9-6ef850f1fd57. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Creating volume glance metadata for volume 4ff32c00-0007-41e6-93b9-6ef850f1fd57 backed by image 8a292454-dc7b-4576-9d3c-c47c5e3f9bbb with: {'image_id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'image_name': 'tempest-scenario-img--1743684102', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec47d4fb-3b9c-4b45-bd18-7bacca9118aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57', 'volume_size': 1, 'image_id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1743684102', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '820e48c124b54804a321e98757bc02f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a292454-dc7b-4576-9d3c-c47c5e3f9bbb', 'created_at': datetime.datetime(2026, 8, 3, 7, 1, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 1, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a292454-dc7b-4576-9d3c-c47c5e3f9bbb/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a8f94b-bfe6-441b-b5c7-d8273e4355f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:53 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Volume volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 (4ff32c00-0007-41e6-93b9-6ef850f1fd57): created successfully Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6a8f94b-bfe6-441b-b5c7-d8273e4355f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Flow 'volume_create_manager' (46f4b9fc-153e-4efa-8f3b-e6eb8edd3670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-168120c7-5807-49a6-a18d-148cd04c4c35 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created volume successfully. Aug 03 09:01:55 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950" returned: 0 in 5.193s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:01:55 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Converted 1024.00 MB image at 197.14 MB/s Aug 03 09:01:55 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 is being set with open permissions: ugo+rw Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:55 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 Aug 03 09:01:55 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:55 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950" returned: 0 in 0.250s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" released by "_copy_volume_from_snapshot" :: held 6.360s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211-8488643f-7421-4fbb-a5f0-0d984f2a7950" released by "_create_volume_from_snapshot" :: held 6.431s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.450s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93cec713-ce23-43df-b0a6-a3f0ce75ae97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8488643f-7421-4fbb-a5f0-0d984f2a7950', 'volume_size': 1, 'snapshot_id': '8058c28a-83d2-4c77-b0d0-49bffc279211'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e508048-4a90-443f-a01d-6dbc7f804c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:01:55 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Volume volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 (8488643f-7421-4fbb-a5f0-0d984f2a7950): created successfully Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e508048-4a90-443f-a01d-6dbc7f804c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:01:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Flow 'volume_create_manager' (1d09e832-27a0-46fb-90bf-b138de17e1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:01:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b48076be-186e-42ba-844c-284eda9b33f1 tempest-VolumesDeleteCascade-1973898149 None] Created volume successfully. Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Performing cascade delete. {{(pid=88796) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-8058c28a-83d2-4c77-b0d0-49bffc279211-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-8058c28a-83d2-4c77-b0d0-49bffc279211-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Deleting offline snapshot 8058c28a-83d2-4c77-b0d0-49bffc279211 of volume b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] snapshot_file for this snap is: volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6de6e-b2a7-4b06-99cc-bc10e0c5b642]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:56 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:56 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2fc90d1f-e883-4da2-bac7-5fcc8867dcbd req-528fd72f-496f-4b58-a3d6-d13a834bc481 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2fc90d1f-e883-4da2-bac7-5fcc8867dcbd req-528fd72f-496f-4b58-a3d6-d13a834bc481 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2fc90d1f-e883-4da2-bac7-5fcc8867dcbd req-528fd72f-496f-4b58-a3d6-d13a834bc481 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-2fc90d1f-e883-4da2-bac7-5fcc8867dcbd req-528fd72f-496f-4b58-a3d6-d13a834bc481 tempest-TestInstancesWithCinderVolumes-1451371698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddcddd22-fc8e-466d-a0da-49502cec50a6', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:01:57 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e24557-3df1-48f3-9b4e-d5e60abb8aa8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-2fc90d1f-e883-4da2-bac7-5fcc8867dcbd req-528fd72f-496f-4b58-a3d6-d13a834bc481 tempest-TestInstancesWithCinderVolumes-1451371698 None] attachment_update completed successfully. Aug 03 09:01:57 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:57 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:58 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.753s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:58 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:58 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:58 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:58 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211 Aug 03 09:01:58 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:58 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b.8058c28a-83d2-4c77-b0d0-49bffc279211" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8058c28a-83d2-4c77-b0d0-49bffc279211" released by "_delete_snapshot" :: held 2.005s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" released by "delete_snapshot" :: held 2.030s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:INSERT=40,cinder:SELECT=114,cinder:UPDATE=109,cinder:DELETE=11 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=102,cinder:UPDATE=106,cinder:INSERT=33,cinder:DELETE=8 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['823066ab-1bdb-4acf-9797-d46fe5da181a', '01f93766-e436-4d0d-9666-218be1802b03', '58c2cdbf-e9e4-4619-83da-79a190cf25c4', '5f84a17a-26e4-4981-806b-cab6c9ee6e8d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:01:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Delete snapshot completed successfully. Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-8058c28a-83d2-4c77-b0d0-49bffc279211-delete_snapshot" released by "delete_snapshot" :: held 2.217s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Snapshots deleted, issuing volume delete {{(pid=88796) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7c2a18-a022-4ea5-9c4f-4296aa107c69]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:01:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:59 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:59 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:59 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.393s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:01:59 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b Aug 03 09:01:59 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:01:59 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Aug 03 09:01:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:01:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b" released by "delete_volume" :: held 0.928s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:01:59 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['811737aa-3229-41a9-915e-c692eabbef0d', '57128504-dd61-45f5-9cbf-579deae6ef3c', 'b3440d6a-9dd0-4c3f-9582-824f541e2d4b', '7c4d1ff3-daa4-4844-892b-c54be52521d9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:00 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:00 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:00 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.437s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Deleted volume successfully. Aug 03 09:02:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b9e9e87e-752d-45ab-9cad-72230b8e4dad tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-b1f109f0-1ae5-4d98-9caf-7d6db1b62f1b-delete_volume" released by "delete_volume" :: held 4.086s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-8488643f-7421-4fbb-a5f0-0d984f2a7950-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-8488643f-7421-4fbb-a5f0-0d984f2a7950-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d88cbd8-69f5-43ed-bed1-53e955b76360]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:01 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 Aug 03 09:02:01 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:01 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950" returned: 0 in 0.424s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:01 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950 Aug 03 09:02:01 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:02 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8488643f-7421-4fbb-a5f0-0d984f2a7950" returned: 0 in 0.270s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-quobyte-8488643f-7421-4fbb-a5f0-0d984f2a7950" released by "delete_volume" :: held 0.741s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Created reservations ['9e65edf1-6182-4fb0-a3ee-bcad024cbd2c', '38ee9dad-2708-493f-bc14-4cec5e1df043', 'b454ad22-fcbc-4793-a381-cf2823648e08', '0362c1aa-aa36-4e7b-bc78-82d91ec85747'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:02 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:02 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:02 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Deleted volume successfully. Aug 03 09:02:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-35a469da-89e1-4476-9d90-1b3974f9bbf6 tempest-VolumesDeleteCascade-1973898149 None] Lock "cinder-8488643f-7421-4fbb-a5f0-0d984f2a7950-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Flow 'volume_create_manager' (c71f4cf9-e9ca-4f14-9bd6-cabfcb10839e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458e25a4-679d-4e56-9b63-630d85d6cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (458e25a4-679d-4e56-9b63-630d85d6cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-464228734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fa94bd-1464-4a37-b71a-822ebbb35918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992b24ce8428410ebc5b9da42afd0923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:06Z,use_quota=True,user_id='ebb2833581e44a28be3484eaacf32df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b071e245-bf83-4823-bd75-6c9f7c48ae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b071e245-bf83-4823-bd75-6c9f7c48ae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429becbb-35aa-4cd9-ad9e-4aa49a09f5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (429becbb-35aa-4cd9-ad9e-4aa49a09f5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80fa94bd-1464-4a37-b71a-822ebbb35918', 'volume_name': 'volume-80fa94bd-1464-4a37-b71a-822ebbb35918', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673ad8b0-386c-4ad9-9165-6a15e2a56d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673ad8b0-386c-4ad9-9165-6a15e2a56d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8cb5b2-c178-4b90-afa5-c6d0ba9ca94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:06 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Volume 80fa94bd-1464-4a37-b71a-822ebbb35918: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80fa94bd-1464-4a37-b71a-822ebbb35918', 'volume_size': 1} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-464228734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fa94bd-1464-4a37-b71a-822ebbb35918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992b24ce8428410ebc5b9da42afd0923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:06Z,use_quota=True,user_id='ebb2833581e44a28be3484eaacf32df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Creating volume 80fa94bd-1464-4a37-b71a-822ebbb35918 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:02:06 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:06 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 1073741824 Aug 03 09:02:06 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:06 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 1073741824" returned: 0 in 0.698s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:07 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 Aug 03 09:02:07 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:07 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918" returned: 0 in 0.329s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8cb5b2-c178-4b90-afa5-c6d0ba9ca94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fa94bd-1464-4a37-b71a-822ebbb35918', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a2872e-5cbc-48ba-babe-e70fdc3e35ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:07 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Volume volume-80fa94bd-1464-4a37-b71a-822ebbb35918 (80fa94bd-1464-4a37-b71a-822ebbb35918): created successfully Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a2872e-5cbc-48ba-babe-e70fdc3e35ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Flow 'volume_create_manager' (c71f4cf9-e9ca-4f14-9bd6-cabfcb10839e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6fb794df-2022-4c28-a7cd-6c5812fbf68b tempest-VolumesMetadataTest-1955088004 None] Created volume successfully. Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:08 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:08 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Acquiring lock "cinder-80fa94bd-1464-4a37-b71a-822ebbb35918-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "cinder-80fa94bd-1464-4a37-b71a-822ebbb35918-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Acquiring lock "cinder-quobyte-80fa94bd-1464-4a37-b71a-822ebbb35918" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "cinder-quobyte-80fa94bd-1464-4a37-b71a-822ebbb35918" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:09 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353956f-95e0-4e6c-ad94-7ec98fd1d476]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.497s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:02:09 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 Aug 03 09:02:09 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:09 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918" returned: 0 in 0.488s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:09 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918 Aug 03 09:02:09 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:10 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80fa94bd-1464-4a37-b71a-822ebbb35918" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "cinder-quobyte-80fa94bd-1464-4a37-b71a-822ebbb35918" released by "delete_volume" :: held 0.913s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Created reservations ['58d5ebb4-4832-4107-9280-f34242dfb32c', '0045e113-6089-4c13-9388-3067b0e04f09', 'e604f8fc-ceef-422e-9f14-f943bd4c5f4f', 'e1e54071-e61c-4f2b-b25a-d9b3c2b17931'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:10 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:10 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:10 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Deleted volume successfully. Aug 03 09:02:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1eefaeaf-c3f8-406a-b1f8-0914a3655f3d tempest-VolumesMetadataTest-1955088004 None] Lock "cinder-80fa94bd-1464-4a37-b71a-822ebbb35918-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Flow 'volume_create_manager' (93257d6c-b48d-4759-9733-85c9f5ee9ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54e562f-61a4-4ff9-be95-41b0705f4d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54e562f-61a4-4ff9-be95-41b0705f4d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-535415042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1936e4-20dd-4672-87d6-3f81e05b1505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6748824a315f43a793585b687cbcc54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:14Z,use_quota=True,user_id='a3bd543b4c4e4f92a29e85bc61ee7794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a2cd4c-d0d8-4dc1-8b38-beaead3bf8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a2cd4c-d0d8-4dc1-8b38-beaead3bf8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d88225a-7a25-4fbb-8f83-2915fcb5f878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d88225a-7a25-4fbb-8f83-2915fcb5f878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b1936e4-20dd-4672-87d6-3f81e05b1505', 'volume_name': 'volume-9b1936e4-20dd-4672-87d6-3f81e05b1505', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa45aa9-3157-4d31-b9f8-64121034cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa45aa9-3157-4d31-b9f8-64121034cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be1bb64-00da-4ff7-a7b0-796eb225001b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Volume 9b1936e4-20dd-4672-87d6-3f81e05b1505: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b1936e4-20dd-4672-87d6-3f81e05b1505', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 09:02:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Trying to clone 9b1936e4-20dd-4672-87d6-3f81e05b1505 from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:02:14 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Image download 20.69 MB at 20.69 MB/s Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee51a5b1-8b87-4ca2-abbf-3b57fd748f55]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:14 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD Aug 03 09:02:14 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:14 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user a3bd543b4c4e4f92a29e85bc61ee7794. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbfb96a-d3d7-495e-a7f9-48d7583778bd]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:14 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD Aug 03 09:02:14 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:15 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-535415042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1936e4-20dd-4672-87d6-3f81e05b1505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6748824a315f43a793585b687cbcc54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:14Z,use_quota=True,user_id='a3bd543b4c4e4f92a29e85bc61ee7794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Creating volume 9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:02:15 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:15 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1073741824 Aug 03 09:02:15 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:15 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1073741824" returned: 0 in 0.667s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:15 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 Aug 03 09:02:15 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:16 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 9b1936e4-20dd-4672-87d6-3f81e05b1505. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3b9520-ff57-4743-8cd0-5068eca4cc6d]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:16 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap Aug 03 09:02:16 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:16 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap" returned: 0 in 0.620s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:17 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap Aug 03 09:02:17 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:17 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap" returned: 1 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7u8w8dap' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f7734-31b5-4281-ade4-7b50c9ec0828]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:17 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD Aug 03 09:02:17 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:17 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:17 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 Aug 03 09:02:17 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-603726a3-3a4c-4d8a-b96c-43409f03d5e7 tempest-TestShelveInstance-2057113503 None] Terminate volume connection completed successfully. Aug 03 09:02:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-603726a3-3a4c-4d8a-b96c-43409f03d5e7 tempest-TestShelveInstance-2057113503 None] Deleting attachment 1e61c3f1-fde7-452a-a77c-f6d9e123d78a. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Acquiring lock "cinder-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "cinder-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Acquiring lock "cinder-quobyte-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "cinder-quobyte-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a14ed4-f149-43a7-acc0-eb12aa5e218b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:18 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 Aug 03 09:02:18 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:18 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" returned: 0 in 0.516s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:18 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366 Aug 03 09:02:18 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:19 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "cinder-quobyte-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366" released by "delete_volume" :: held 1.045s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.quota [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Created reservations ['22bd5695-c874-4932-9299-6487069d186e', '91621a32-4b95-4514-a1b0-b03ce44da891', '985bb632-4d3f-480d-bd3a-8e5f9af39c97', '229a8400-9a29-4fad-9770-5bbcc8d4e7ff'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:19 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:19 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:19 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.manager [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Deleted volume successfully. Aug 03 09:02:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-88fdba56-2836-4bc8-b28c-02306512f5c1 req-9dfa3321-5def-478b-a09e-01c8ac62af14 tempest-TestShelveInstance-2057113503 None] Lock "cinder-6b1607f4-ba5d-40fd-9d4d-f2c2a1e29366-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:20 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505" returned: 0 in 2.340s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_o6uz8_pxdevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:02:20 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Converted 112.00 MB image at 47.85 MB/s Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:20 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1G Aug 03 09:02:20 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:20 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 1G" returned: 0 in 0.363s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 9b1936e4-20dd-4672-87d6-3f81e05b1505 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user a3bd543b4c4e4f92a29e85bc61ee7794 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Marking volume 9b1936e4-20dd-4672-87d6-3f81e05b1505 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to 9b1936e4-20dd-4672-87d6-3f81e05b1505. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Creating volume glance metadata for volume 9b1936e4-20dd-4672-87d6-3f81e05b1505 backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be1bb64-00da-4ff7-a7b0-796eb225001b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1936e4-20dd-4672-87d6-3f81e05b1505', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb2c239-5409-4d5a-872c-d2b7d8aef0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:20 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Volume volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 (9b1936e4-20dd-4672-87d6-3f81e05b1505): created successfully Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb2c239-5409-4d5a-872c-d2b7d8aef0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Flow 'volume_create_manager' (93257d6c-b48d-4759-9733-85c9f5ee9ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-441b9cb1-d8e4-41e8-b604-d2002c3306d1 tempest-VolumesExtendTest-653395142 None] Created volume successfully. Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef8c26-2fc3-4842-86ce-50973f6f47bb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:21 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 Aug 03 09:02:21 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:21 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 2G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 2G" returned: 0 in 0.128s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.528s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1112c15b-20eb-4af6-8468-aa6233ac1ce8 tempest-VolumesExtendTest-653395142 None] Extend volume completed successfully. Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-9b1936e4-20dd-4672-87d6-3f81e05b1505-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "cinder-9b1936e4-20dd-4672-87d6-3f81e05b1505-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-quobyte-9b1936e4-20dd-4672-87d6-3f81e05b1505" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-9b1936e4-20dd-4672-87d6-3f81e05b1505" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee824c3b-c764-4750-80f7-7876ce6ef51b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:22 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 Aug 03 09:02:22 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:23 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505" returned: 0 in 0.421s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:23 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505 Aug 03 09:02:23 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:23 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9b1936e4-20dd-4672-87d6-3f81e05b1505" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-9b1936e4-20dd-4672-87d6-3f81e05b1505" released by "delete_volume" :: held 0.734s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Created reservations ['12b014b2-4de9-47c0-98a6-f41e88feb488', '0c168782-cc13-4d7e-a331-1dbe40ae513e', '646b9541-a28d-4954-8bbc-b4bcebaf81fe', '75427253-1b4e-4e66-a34e-67d6285732db'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:23 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:23 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:23 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Deleted volume successfully. Aug 03 09:02:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ec1f8eea-288f-485b-b6ed-79670b72ed8e tempest-VolumesExtendTest-653395142 None] Lock "cinder-9b1936e4-20dd-4672-87d6-3f81e05b1505-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Flow 'volume_create_manager' (089dbcd0-86af-47ca-92a7-7f02d879118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd992b6-e969-4f95-b6e0-4cb471eb5b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd992b6-e969-4f95-b6e0-4cb471eb5b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395071352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b77cb-1b39-44a9-9b14-a4030684ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6748824a315f43a793585b687cbcc54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:24Z,use_quota=True,user_id='a3bd543b4c4e4f92a29e85bc61ee7794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f72af48-cc2a-40f6-85db-d1d649b8b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f72af48-cc2a-40f6-85db-d1d649b8b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1daf22-ca9f-48b1-8767-bbc4d73e87dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1daf22-ca9f-48b1-8767-bbc4d73e87dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053b77cb-1b39-44a9-9b14-a4030684ce06', 'volume_name': 'volume-053b77cb-1b39-44a9-9b14-a4030684ce06', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38559c19-ef0a-46db-bb4e-5a0e92a1ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38559c19-ef0a-46db-bb4e-5a0e92a1ed33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9705cdea-ed09-4a6b-a30d-76f0dd6426f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Volume 053b77cb-1b39-44a9-9b14-a4030684ce06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053b77cb-1b39-44a9-9b14-a4030684ce06', 'volume_size': 1} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1395071352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b77cb-1b39-44a9-9b14-a4030684ce06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6748824a315f43a793585b687cbcc54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:02:24Z,use_quota=True,user_id='a3bd543b4c4e4f92a29e85bc61ee7794',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Creating volume 053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:02:24 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:24 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 1073741824 Aug 03 09:02:24 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:24 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 1073741824" returned: 0 in 0.490s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:24 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:24 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:25 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9705cdea-ed09-4a6b-a30d-76f0dd6426f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053b77cb-1b39-44a9-9b14-a4030684ce06', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e83a64-84df-411d-b1c1-3d314565f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:02:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Volume volume-053b77cb-1b39-44a9-9b14-a4030684ce06 (053b77cb-1b39-44a9-9b14-a4030684ce06): created successfully Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e83a64-84df-411d-b1c1-3d314565f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Flow 'volume_create_manager' (089dbcd0-86af-47ca-92a7-7f02d879118a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:02:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4243ba1f-f659-4867-a057-41352ea54ce8 tempest-VolumesExtendTest-653395142 None] Created volume successfully. Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Creating offline snapshot a10aa0e7-8e99-40e4-a571-796e78221b76 of volume 053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dce349-5381-4d0c-aa32-6f6f7b5a6c33]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:25 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:25 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:25 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:25 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 1G Aug 03 09:02:25 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:26 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 1G" returned: 0 in 0.557s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b77cb-1b39-44a9-9b14-a4030684ce06 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:26 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b77cb-1b39-44a9-9b14-a4030684ce06 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 Aug 03 09:02:26 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:26 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-053b77cb-1b39-44a9-9b14-a4030684ce06 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76" returned: 0 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 is being set with open permissions: ugo+rw Aug 03 09:02:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:26 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 Aug 03 09:02:26 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:27 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76" returned: 0 in 0.303s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:27 devstack sudo[108361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info Aug 03 09:02:27 devstack sudo[108361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:27 devstack sudo[108361]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info" returned: 0 in 0.307s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:27 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info is being set with open permissions: ugo+rw Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:27 devstack sudo[108364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info Aug 03 09:02:27 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:27 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.info" returned: 0 in 0.329s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8eb27034-1e83-44e6-8cec-9514a54be035 tempest-VolumesExtendTest-653395142 None] Create snapshot completed successfully Aug 03 09:02:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[079b0505-aba4-4043-8072-bd8ee4db4ff2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:28 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:28 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:29 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.407s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 2G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 2G" returned: 0 in 0.153s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.598s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-115d3da0-1d29-4f76-bec3-21b7164a2f76 tempest-VolumesExtendTest-653395142 None] Extend volume completed successfully. Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-a10aa0e7-8e99-40e4-a571-796e78221b76-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-a10aa0e7-8e99-40e4-a571-796e78221b76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-quobyte-a10aa0e7-8e99-40e4-a571-796e78221b76" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-a10aa0e7-8e99-40e4-a571-796e78221b76" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Deleting offline snapshot a10aa0e7-8e99-40e4-a571-796e78221b76 of volume 053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] snapshot_file for this snap is: volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca7722-2814-42d7-b679-181547d72fa1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:30 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 Aug 03 09:02:30 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:30 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-053b77cb-1b39-44a9-9b14-a4030684ce06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0121f3ee-0872-4cce-9e10-cffc4d858225]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:30 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:30 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2b3ad8a5-b043-4f72-83f6-bbbd19eeebe2 req-a589d0e3-fe15-4ff6-b38c-0ccd039b1d1e tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2b3ad8a5-b043-4f72-83f6-bbbd19eeebe2 req-a589d0e3-fe15-4ff6-b38c-0ccd039b1d1e tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2b3ad8a5-b043-4f72-83f6-bbbd19eeebe2 req-a589d0e3-fe15-4ff6-b38c-0ccd039b1d1e tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-2b3ad8a5-b043-4f72-83f6-bbbd19eeebe2 req-a589d0e3-fe15-4ff6-b38c-0ccd039b1d1e tempest-TestInstancesWithCinderVolumes-1451371698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da5a9119-ce58-42c0-bf48-a03f352943a1', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:02:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-2b3ad8a5-b043-4f72-83f6-bbbd19eeebe2 req-a589d0e3-fe15-4ff6-b38c-0ccd039b1d1e tempest-TestInstancesWithCinderVolumes-1451371698 None] attachment_update completed successfully. Aug 03 09:02:31 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:31 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 Aug 03 09:02:31 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:31 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76" returned: 0 in 0.492s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:31 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76 Aug 03 09:02:31 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:31 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06.a10aa0e7-8e99-40e4-a571-796e78221b76" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-a10aa0e7-8e99-40e4-a571-796e78221b76" released by "_delete_snapshot" :: held 1.780s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" released by "delete_snapshot" :: held 1.821s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Created reservations ['016d7a9f-ee9a-4e8b-a9c4-b72a4d1d1266', 'ebe8b9d2-9303-45f4-964c-e0abc03e5f5d', '4895a96c-eecb-4f72-b686-9400d9d9998a', 'c724dde8-53e5-4157-ba88-d04be956dd95'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Delete snapshot completed successfully. Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-38fe20d2-ee8d-4460-ad7d-c8bb85b87b34 tempest-VolumesExtendTest-653395142 None] Lock "cinder-a10aa0e7-8e99-40e4-a571-796e78221b76-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-053b77cb-1b39-44a9-9b14-a4030684ce06-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "cinder-053b77cb-1b39-44a9-9b14-a4030684ce06-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Acquiring lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9996bcb9-df81-47df-aedb-2d64a0548045]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:32 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:32 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:32 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:32 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06 Aug 03 09:02:32 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:33 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-053b77cb-1b39-44a9-9b14-a4030684ce06" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "cinder-quobyte-053b77cb-1b39-44a9-9b14-a4030684ce06" released by "delete_volume" :: held 0.743s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Created reservations ['9a7df32b-14ad-44b4-b922-7e92f9966c42', '7ff99015-f398-4b57-84d7-659cbe6ee304', '8117cba6-bfde-47c3-88fd-a051267a4163', 'fbf34154-dbb1-4027-8dd0-a7b67ca72c08'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:33 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:33 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:33 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Deleted volume successfully. Aug 03 09:02:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e0610bab-5636-4f19-ae33-b5e94d7a74f2 tempest-VolumesExtendTest-653395142 None] Lock "cinder-053b77cb-1b39-44a9-9b14-a4030684ce06-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-29cedb57-662a-47fc-a74f-98bb4be7c56c req-e2045839-0a95-47b4-8a7c-f5092dc47033 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-29cedb57-662a-47fc-a74f-98bb4be7c56c req-e2045839-0a95-47b4-8a7c-f5092dc47033 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-29cedb57-662a-47fc-a74f-98bb4be7c56c req-e2045839-0a95-47b4-8a7c-f5092dc47033 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-29cedb57-662a-47fc-a74f-98bb4be7c56c req-e2045839-0a95-47b4-8a7c-f5092dc47033 tempest-TestInstancesWithCinderVolumes-1451371698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-d50897a0-c575-4cdb-8ee4-2cec80628c21', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b613280-0a77-4571-95ef-a3b4b09116b0', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:02:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-29cedb57-662a-47fc-a74f-98bb4be7c56c req-e2045839-0a95-47b4-8a7c-f5092dc47033 tempest-TestInstancesWithCinderVolumes-1451371698 None] attachment_update completed successfully. Aug 03 09:02:41 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f2df724c-42b6-4827-af46-25cd7903a341 req-c1a537f4-24a8-46b8-914e-e197d1de77fe tempest-TestInstancesWithCinderVolumes-1451371698 None] Terminate volume connection completed successfully. Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f2df724c-42b6-4827-af46-25cd7903a341 req-c1a537f4-24a8-46b8-914e-e197d1de77fe tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleting attachment da5a9119-ce58-42c0-bf48-a03f352943a1. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-quobyte-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ede377-cca2-4e65-9c34-53a0af0e6512]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:41 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d Aug 03 09:02:41 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:42 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" returned: 0 in 0.518s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:42 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d Aug 03 09:02:42 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:42 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d" released by "delete_volume" :: held 0.954s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:42 devstack cinder-volume[88796]: WARNING cinder.quota [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405483632-743590836 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405483632-743590836, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:02:42 devstack cinder-volume[88796]: WARNING cinder.quota [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405483632-743590836 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405483632-743590836, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created reservations ['442a6e24-6c0f-4891-be3c-56c7ad00bb24', 'f5a18654-92fd-41b4-95d5-3ebd0fdb756c', '67f93896-c96b-43d3-99f8-c6f0a493bbcd', 'e9e9f182-7a72-452b-9c6a-4b332cfe3c89'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:42 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:42 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:43 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:43 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleted volume successfully. Aug 03 09:02:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6420769e-6225-4059-bf9b-5eb3593e7208 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-1cc16a1e-1b45-40b1-8b88-81c4ebe16f1d-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-0760b59e-1e0e-4c82-9b0c-d11197a43e28 req-595b3b5b-251e-40f8-9bad-304ea207997e tempest-TestInstancesWithCinderVolumes-1451371698 None] Terminate volume connection completed successfully. Aug 03 09:02:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-0760b59e-1e0e-4c82-9b0c-d11197a43e28 req-595b3b5b-251e-40f8-9bad-304ea207997e tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleting attachment 6b613280-0a77-4571-95ef-a3b4b09116b0. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:02:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-d50897a0-c575-4cdb-8ee4-2cec80628c21-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-d50897a0-c575-4cdb-8ee4-2cec80628c21-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-quobyte-d50897a0-c575-4cdb-8ee4-2cec80628c21" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-d50897a0-c575-4cdb-8ee4-2cec80628c21" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9657f75b-f33f-44ba-a11b-82e966c517a9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:47 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 Aug 03 09:02:47 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:47 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21" returned: 0 in 0.554s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:47 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21 Aug 03 09:02:47 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:48 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d50897a0-c575-4cdb-8ee4-2cec80628c21" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-d50897a0-c575-4cdb-8ee4-2cec80628c21" released by "delete_volume" :: held 1.071s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:48 devstack cinder-volume[88796]: WARNING cinder.quota [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951364565-1577120114 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951364565-1577120114, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:02:48 devstack cinder-volume[88796]: WARNING cinder.quota [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951364565-1577120114 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1951364565-1577120114, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created reservations ['86bcb190-06c1-4b1f-ac03-a23e8622d939', '5fc2b3dd-3637-41ec-8025-2dba306833a7', 'fc8c1fa5-5d0c-43ca-bd80-4dadb9b7e425', '414e9641-776f-4ec3-8b48-9b2fd996ec53'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:02:48 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:02:48 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:02:48 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:02:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleted volume successfully. Aug 03 09:02:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a28d60ea-74f2-4d98-9795-4108c4ee7d90 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-d50897a0-c575-4cdb-8ee4-2cec80628c21-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:02:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-d19124f9-f492-4003-89cc-2826a13229c4 req-433d8072-0a8f-416b-b76b-7b78d03b4410 tempest-TestInstancesWithCinderVolumes-1451371698 None] Terminate volume connection completed successfully. Aug 03 09:02:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-d19124f9-f492-4003-89cc-2826a13229c4 req-433d8072-0a8f-416b-b76b-7b78d03b4410 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleting attachment ddcddd22-fc8e-466d-a0da-49502cec50a6. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:03:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-4ff32c00-0007-41e6-93b9-6ef850f1fd57-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:03:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-4ff32c00-0007-41e6-93b9-6ef850f1fd57-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:03:03 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=90,cinder:INSERT=36,cinder:UPDATE=89,cinder:DELETE=5 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:03:03 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=102,cinder:DELETE=7 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "cinder-quobyte-4ff32c00-0007-41e6-93b9-6ef850f1fd57" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-4ff32c00-0007-41e6-93b9-6ef850f1fd57" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b6ffc4-6e41-4053-a938-b49f54715fdd]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:04 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 Aug 03 09:03:04 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (b694be61-7d1e-419b-93e7-c53a9027eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09c8867-f6de-4c10-812d-018891e83bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09c8867-f6de-4c10-812d-018891e83bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1894145900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a21d8-e281-4749-be63-9863d10524bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caaa9e8a9046029ce30f8430e655a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:03:04Z,use_quota=True,user_id='a24827caa3e945a988603626b50e1f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a71f99-c16e-4600-a0ca-e30afaf61929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a71f99-c16e-4600-a0ca-e30afaf61929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce3240-ba57-422d-9830-6bb7732d4556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:03:04 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57" returned: 0 in 0.449s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:04 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57 Aug 03 09:03:04 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ce3240-ba57-422d-9830-6bb7732d4556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3e4a21d8-e281-4749-be63-9863d10524bb', 'volume_name': 'volume-3e4a21d8-e281-4749-be63-9863d10524bb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d038b9-3df4-424c-bfab-9ceb882081ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d038b9-3df4-424c-bfab-9ceb882081ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66e0499-a0ce-4865-ab9f-12c847966d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Volume 3e4a21d8-e281-4749-be63-9863d10524bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3e4a21d8-e281-4749-be63-9863d10524bb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Trying to clone 3e4a21d8-e281-4749-be63-9863d10524bb from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:03:04 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4ff32c00-0007-41e6-93b9-6ef850f1fd57" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-quobyte-4ff32c00-0007-41e6-93b9-6ef850f1fd57" released by "delete_volume" :: held 0.867s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:03:05 devstack cinder-volume[88796]: WARNING cinder.quota [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-183609900-152001021 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-183609900-152001021, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:03:05 devstack cinder-volume[88796]: WARNING cinder.quota [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-183609900-152001021 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-183609900-152001021, it is now deprecated. Please use the default quota class for default quota. Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Created reservations ['54482324-5170-4cfb-82d4-01922cf059d0', '5ac2004e-4f6f-403d-840d-5636cb420d50', '6a12e428-28fc-4ae3-a1ff-3ad90c35e9e4', '65c2a8e9-ed44-445f-9925-2c11a33c07a0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:03:05 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Image download 20.69 MB at 20.69 MB/s Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb5c041-33d7-4df6-aa27-bc6f5e9b8a95]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:05 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:03:05 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:05 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD Aug 03 09:03:05 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:05 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:03:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Deleted volume successfully. Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-fc5c2124-cc32-4406-a679-163e5ca759e3 tempest-TestInstancesWithCinderVolumes-1451371698 None] Lock "cinder-4ff32c00-0007-41e6-93b9-6ef850f1fd57-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:03:05 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user a24827caa3e945a988603626b50e1f31. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb464a-e7a4-4d9a-ac39-44cee5a76c5e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:05 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD Aug 03 09:03:05 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:05 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1894145900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a21d8-e281-4749-be63-9863d10524bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caaa9e8a9046029ce30f8430e655a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:03:04Z,use_quota=True,user_id='a24827caa3e945a988603626b50e1f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Creating volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:03:05 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:03:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:05 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1073741824 Aug 03 09:03:05 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:06 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1073741824" returned: 0 in 0.540s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:06 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb Aug 03 09:03:06 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:06 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 3e4a21d8-e281-4749-be63-9863d10524bb. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfa2064-9b51-4992-9003-1141bf2d8dae]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:07 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs Aug 03 09:03:07 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:07 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs" returned: 0 in 0.360s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:07 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs Aug 03 09:03:07 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:07 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs" returned: 1 in 0.365s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_5l408bzs' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f091987a-7a79-4f51-83df-66cc99d2d363]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:07 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD Aug 03 09:03:07 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:08 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:08 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb Aug 03 09:03:08 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:08 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:03:08 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:09 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.320s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:03:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:03:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:03:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:03:10 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb" returned: 0 in 2.678s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:10 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_7oopnnzddevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:03:10 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Converted 112.00 MB image at 41.74 MB/s Aug 03 09:03:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:10 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1G Aug 03 09:03:10 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:11 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb 1G" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 3e4a21d8-e281-4749-be63-9863d10524bb successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user a24827caa3e945a988603626b50e1f31 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Marking volume 3e4a21d8-e281-4749-be63-9863d10524bb as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to 3e4a21d8-e281-4749-be63-9863d10524bb. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Creating volume glance metadata for volume 3e4a21d8-e281-4749-be63-9863d10524bb backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66e0499-a0ce-4865-ab9f-12c847966d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4a21d8-e281-4749-be63-9863d10524bb', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cb4ea3-fede-4c03-b6ea-78b8de6df224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Volume volume-3e4a21d8-e281-4749-be63-9863d10524bb (3e4a21d8-e281-4749-be63-9863d10524bb): created successfully Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cb4ea3-fede-4c03-b6ea-78b8de6df224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (b694be61-7d1e-419b-93e7-c53a9027eb27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:03:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fb055526-13f9-4d1b-a758-fcc6e06a0186 tempest-TestVolumeBootPattern-990222927 None] Created volume successfully. Aug 03 09:03:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9aa1064c-3e04-449c-be74-268524f0546d req-d376d54b-e79f-4d3d-95eb-e9c4fa07784a tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9aa1064c-3e04-449c-be74-268524f0546d req-d376d54b-e79f-4d3d-95eb-e9c4fa07784a tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-9aa1064c-3e04-449c-be74-268524f0546d req-d376d54b-e79f-4d3d-95eb-e9c4fa07784a tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-9aa1064c-3e04-449c-be74-268524f0546d req-d376d54b-e79f-4d3d-95eb-e9c4fa07784a tempest-TestVolumeBootPattern-990222927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-3e4a21d8-e281-4749-be63-9863d10524bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6b536d1-c5d6-46c3-a8d2-2ecb52d00378', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:03:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-9aa1064c-3e04-449c-be74-268524f0546d req-d376d54b-e79f-4d3d-95eb-e9c4fa07784a tempest-TestVolumeBootPattern-990222927 None] attachment_update completed successfully. Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Flow 'volume_create_manager' (18103f87-1ebf-4b32-97ee-fd6f2a3ac10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925aeaf6-d2f7-4b08-a58b-f6120f9c90e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (925aeaf6-d2f7-4b08-a58b-f6120f9c90e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-28946432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64016f71a964277b8849493395aa476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:03:21Z,use_quota=True,user_id='9f8a28de59b24817b22ade94835e0a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f63aca4-4287-48a5-8e4b-0316df2a6160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f63aca4-4287-48a5-8e4b-0316df2a6160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e77e0-75a4-477b-a4f2-79c19a5dee22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e77e0-75a4-477b-a4f2-79c19a5dee22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c', 'volume_name': 'volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3b5091-8df6-46ec-9cfa-c5953db4a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae3b5091-8df6-46ec-9cfa-c5953db4a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12afcaa-f601-4f05-b5e0-56ba551c11eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Volume 3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c', 'volume_size': 1} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-28946432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a64016f71a964277b8849493395aa476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:03:21Z,use_quota=True,user_id='9f8a28de59b24817b22ade94835e0a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Creating volume 3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:03:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:03:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:21 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c 1073741824 Aug 03 09:03:21 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:22 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c 1073741824" returned: 0 in 0.716s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:22 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c Aug 03 09:03:22 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:22 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12afcaa-f601-4f05-b5e0-56ba551c11eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fbba99-db57-4f26-94d3-d14107c86c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:03:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Volume volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c (3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c): created successfully Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07fbba99-db57-4f26-94d3-d14107c86c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:03:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Flow 'volume_create_manager' (18103f87-1ebf-4b32-97ee-fd6f2a3ac10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:03:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-51be97a1-0b1b-43dd-8aad-6fce123d0f23 tempest-TestMinimumBasicScenario-1327347563 None] Created volume successfully. Aug 03 09:03:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-98057e2b-565d-413e-8b3b-e4abdc70b3c9 req-5306d85c-43b4-4934-a8a7-7b835547b9ec tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-98057e2b-565d-413e-8b3b-e4abdc70b3c9 req-5306d85c-43b4-4934-a8a7-7b835547b9ec tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-98057e2b-565d-413e-8b3b-e4abdc70b3c9 req-5306d85c-43b4-4934-a8a7-7b835547b9ec tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:03:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-98057e2b-565d-413e-8b3b-e4abdc70b3c9 req-5306d85c-43b4-4934-a8a7-7b835547b9ec tempest-TestMinimumBasicScenario-1327347563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5c9c23c-801a-4efd-a2f3-18681d0b7fda', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:03:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-98057e2b-565d-413e-8b3b-e4abdc70b3c9 req-5306d85c-43b4-4934-a8a7-7b835547b9ec tempest-TestMinimumBasicScenario-1327347563 None] attachment_update completed successfully. Aug 03 09:03:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=25,cinder:INSERT=12,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:03:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=23,cinder:SELECT=33,cinder:INSERT=7,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:03:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:03:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:03:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Creating online snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:03:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc57f778-3ae1-4b58-b3f4-026f00920940]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:03:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:57 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb Aug 03 09:03:57 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:57 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb" returned: 0 in 0.630s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:57 devstack sudo[109515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e 1G Aug 03 09:03:57 devstack sudo[109515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:58 devstack sudo[109515]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e 1G" returned: 0 in 0.547s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:58 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e Aug 03 09:03:58 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:58 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:58 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is being set with open permissions: ugo+rw Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:03:58 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e Aug 03 09:03:58 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:03:58 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" returned: 0 in 0.336s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}26fdefe5a773128071c27d6bbcd446e530b8c5f39ce63a1b3d622d84a8e57062" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb", "create_info": {"type": "qcow2", "new_file": "volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e", "snapshot_id": "7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:03:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc2c2040-dfa7-43df-b288-94805867067f x-openstack-request-id: req-bc2c2040-dfa7-43df-b288-94805867067f {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3e4a21d8-e281-4749-be63-9863d10524bb"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-bc2c2040-dfa7-43df-b288-94805867067f {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:03:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:03:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:08 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:04:08 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:09 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:04:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-91e30ba0-426a-4854-be71-a46187adde52 req-a169108c-72d5-410b-8e48-cd5a52bbcf9b tempest-TestMinimumBasicScenario-1327347563 None] Terminate volume connection completed successfully. Aug 03 09:04:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-91e30ba0-426a-4854-be71-a46187adde52 req-a169108c-72d5-410b-8e48-cd5a52bbcf9b tempest-TestMinimumBasicScenario-1327347563 None] Deleting attachment f5c9c23c-801a-4efd-a2f3-18681d0b7fda. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:16 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info Aug 03 09:04:16 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:16 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:16 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info is being set with open permissions: ugo+rw Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:16 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info Aug 03 09:04:16 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:16 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.info" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.975s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-92e8b0b0-de82-4347-9bbd-65ecbd1ad123 tempest-TestVolumeBootPattern-990222927 None] Create snapshot completed successfully Aug 03 09:04:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "cinder-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "cinder-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "cinder-quobyte-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "cinder-quobyte-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4e5cf3-080c-4958-81d7-86867af03be2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:17 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c Aug 03 09:04:17 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:17 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" returned: 0 in 0.560s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:17 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c Aug 03 09:04:17 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Creating online snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:04:17 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "cinder-quobyte-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c" released by "delete_volume" :: held 0.953s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[587dd6dd-a280-4ef1-8fe1-a8e5ca881dc1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Created reservations ['fd9268da-6a07-4665-b497-6d17282b53ec', 'd084a922-8c50-4b53-aa47-905196b4f543', '53bdff0a-aa78-431e-94c3-d02a451cf35c', 'ae71dedc-eae6-493f-b5f2-1ae56a98fc96'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:04:18 devstack sudo[109658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e Aug 03 09:04:18 devstack sudo[109658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:18 devstack sudo[109660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:04:18 devstack sudo[109660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:18 devstack sudo[109658]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:18 devstack sudo[109660]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.301s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:04:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Deleted volume successfully. Aug 03 09:04:18 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b 1G Aug 03 09:04:18 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8e72495d-4f7e-483b-b1a2-dd47145d521f tempest-TestMinimumBasicScenario-1327347563 None] Lock "cinder-3fa82bd3-1abf-4e03-a566-8cc4a53b0f7c-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:04:19 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b 1G" returned: 0 in 0.551s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:19 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b Aug 03 09:04:19 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:19 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b is being set with open permissions: ugo+rw Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:19 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b Aug 03 09:04:19 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:19 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:04:19 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}b81438da07d5ad06b5c2e2ec7710fe00c88ec4ed5d73efac16291fe67c8ad39f" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-035832b6-868b-459d-82ed-9cebb6d75556" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb", "create_info": {"type": "qcow2", "new_file": "volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b", "snapshot_id": "237a153d-3e39-4180-98f7-8f07bd1b528b"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:04:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:04:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8812d14b-4f4f-4031-892a-ce79ded1f341 x-openstack-request-id: req-8812d14b-4f4f-4031-892a-ce79ded1f341 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:04:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3e4a21d8-e281-4749-be63-9863d10524bb"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:04:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-8812d14b-4f4f-4031-892a-ce79ded1f341 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:04:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:04:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (62013326-30f9-42b2-890a-3cc2d3c566f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da8673e-6680-4cc8-8568-233a223ff153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da8673e-6680-4cc8-8568-233a223ff153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048523785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa0ffb-149d-43aa-8367-50d7fd830c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:34Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e320e3e-4554-4ab5-b4ed-f65a0fccce80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e320e3e-4554-4ab5-b4ed-f65a0fccce80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e31ab2-7b50-41ee-a7f2-46f3670daac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e31ab2-7b50-41ee-a7f2-46f3670daac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bfa0ffb-149d-43aa-8367-50d7fd830c79', 'volume_name': 'volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a3e232-dcbd-463e-87e5-21bfb48f769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a3e232-dcbd-463e-87e5-21bfb48f769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ab840-092c-449a-a727-5fea102e3868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:33 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume 1bfa0ffb-149d-43aa-8367-50d7fd830c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79', 'volume_size': 1} Aug 03 09:04:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 21.543s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.516s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1048523785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bfa0ffb-149d-43aa-8367-50d7fd830c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:34Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume 1bfa0ffb-149d-43aa-8367-50d7fd830c79 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:04:39 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:39 devstack sudo[109758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 1073741824 Aug 03 09:04:39 devstack sudo[109758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-035832b6-868b-459d-82ed-9cebb6d75556 tempest-TestVolumeBootPattern-990222927 None] Create snapshot completed successfully Aug 03 09:04:39 devstack sudo[109758]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 1073741824" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:40 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 Aug 03 09:04:40 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:40 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.257s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25ab840-092c-449a-a727-5fea102e3868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921abcbb-871b-4daf-89ba-b5f1bf65c6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Creating online snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:04:40 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 (1bfa0ffb-149d-43aa-8367-50d7fd830c79): created successfully Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921abcbb-871b-4daf-89ba-b5f1bf65c6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (62013326-30f9-42b2-890a-3cc2d3c566f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa49018c-909d-4bf4-a4d0-e85f873fcb3e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fe81d907-1cce-4555-8790-57962bbf8da6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:04:40 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b Aug 03 09:04:40 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:40 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:04:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:40 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf 1G Aug 03 09:04:40 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:41 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf 1G" returned: 0 in 0.469s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:41 devstack sudo[109811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf Aug 03 09:04:41 devstack sudo[109811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:41 devstack sudo[109811]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:41 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf is being set with open permissions: ugo+rw Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:41 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf Aug 03 09:04:41 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:41 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (c0d50509-e0d4-4d05-a9cc-de060c6afcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b7a926-eea9-472d-85f0-c8402a74b6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b7a926-eea9-472d-85f0-c8402a74b6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037251399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbc6d15-f8de-496f-b949-88090f9721dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:42Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0236404-8b3a-4f13-a55d-8e8442417042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0236404-8b3a-4f13-a55d-8e8442417042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdef0a5-db82-4578-9a2f-c090282551c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdef0a5-db82-4578-9a2f-c090282551c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbc6d15-f8de-496f-b949-88090f9721dd', 'volume_name': 'volume-dbbc6d15-f8de-496f-b949-88090f9721dd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889155ea-8178-49f1-a2a1-227cfbef421d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889155ea-8178-49f1-a2a1-227cfbef421d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9bb10-d30c-47dd-a1d1-1c95e5236be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume dbbc6d15-f8de-496f-b949-88090f9721dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbc6d15-f8de-496f-b949-88090f9721dd', 'volume_size': 1} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}99234a6d065aa06921ad656d177a4893593dc0aad0bdf1b6edb97bcb8af74b89" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb", "create_info": {"type": "qcow2", "new_file": "volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf", "snapshot_id": "4ce7769b-03e2-4bb2-b705-5ff49455d0bf"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:04:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f105cdf-344a-4b55-b3e3-cba5916cb901 x-openstack-request-id: req-8f105cdf-344a-4b55-b3e3-cba5916cb901 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "3e4a21d8-e281-4749-be63-9863d10524bb"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-8f105cdf-344a-4b55-b3e3-cba5916cb901 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (f0b22918-1f8a-4e50-a0c7-f370c4f4d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d01617-4d48-4e0e-a034-526623aa6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d01617-4d48-4e0e-a034-526623aa6e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641927083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3b5dd3-4f09-4a33-ae6c-01a731937be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cbd7d-c85b-457d-8893-7237e658e3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184cbd7d-c85b-457d-8893-7237e658e3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8cd89f-9341-4c81-8f9e-1262d9f6167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb8cd89f-9341-4c81-8f9e-1262d9f6167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d3b5dd3-4f09-4a33-ae6c-01a731937be5', 'volume_name': 'volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8085745-33d2-458f-9995-16d22b0c2c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8085745-33d2-458f-9995-16d22b0c2c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61fab3-0d1c-4a38-b235-6f046affeb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume 4d3b5dd3-4f09-4a33-ae6c-01a731937be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5', 'volume_size': 1} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Flow 'volume_create_manager' (f558550e-1c0d-4f2b-b6c7-ef17f81f72b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8325549-21de-427a-9ac0-d244f69d46f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8325549-21de-427a-9ac0-d244f69d46f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1311886571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be37cbd-4ce9-49bd-a798-ce5797dbbe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934b4beb799c422e84cb6b328d714381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='2eb2353abdf34ca997580903c4f9b35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5378361c-4fcc-41d0-83c2-1aa04ec86821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5378361c-4fcc-41d0-83c2-1aa04ec86821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8001f95a-bdbd-4d85-8206-84201e1346a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8001f95a-bdbd-4d85-8206-84201e1346a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be37cbd-4ce9-49bd-a798-ce5797dbbe52', 'volume_name': 'volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56d5434-6851-4008-a6d5-7911f31fa9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c56d5434-6851-4008-a6d5-7911f31fa9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773d901-0546-4a62-b212-ad6caa1a4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Volume 5be37cbd-4ce9-49bd-a798-ce5797dbbe52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52', 'volume_size': 1} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (f2ce6416-8627-4d2d-8b4d-77150dff152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195ad2e8-0a90-4763-a7a6-a525231cca22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195ad2e8-0a90-4763-a7a6-a525231cca22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256991295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a748a7b-9f9b-489f-bc29-eec48cdfaf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4715739-4db9-4908-9b88-3e48cfa6a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4715739-4db9-4908-9b88-3e48cfa6a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0a317-1b04-4f2a-a805-5438234922aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0a317-1b04-4f2a-a805-5438234922aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a748a7b-9f9b-489f-bc29-eec48cdfaf75', 'volume_name': 'volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0141612d-f568-4a81-8311-eec225d3ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0141612d-f568-4a81-8311-eec225d3ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e59d37c-a0bc-453c-b4ff-34a5dd777d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume 5a748a7b-9f9b-489f-bc29-eec48cdfaf75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75', 'volume_size': 1} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (08f0fd43-62e7-4ace-9849-d48ec0517c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3312ac-9733-4e2e-8ad2-03c024bcdf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3312ac-9733-4e2e-8ad2-03c024bcdf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922856677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd44d3db-a9a3-4afb-a609-3a020e175c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4052087c-7e42-459a-9177-c196ab1f55a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4052087c-7e42-459a-9177-c196ab1f55a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adbb44e-6faf-49f9-8aae-c840ab2da676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adbb44e-6faf-49f9-8aae-c840ab2da676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd44d3db-a9a3-4afb-a609-3a020e175c90', 'volume_name': 'volume-dd44d3db-a9a3-4afb-a609-3a020e175c90', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc7cc85-ba1f-456d-8756-3d8ab64e82e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc7cc85-ba1f-456d-8756-3d8ab64e82e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd690277-c967-4517-a460-e67fca0b940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume dd44d3db-a9a3-4afb-a609-3a020e175c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd44d3db-a9a3-4afb-a609-3a020e175c90', 'volume_size': 1} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (38c80b03-ba04-40c9-ba2c-523035bf654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efa1a7f-613b-42ae-a98a-f7c407299f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2efa1a7f-613b-42ae-a98a-f7c407299f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799552617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f3a0f3-7e64-4dec-8a58-3c6476af828b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:44Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a55601-d107-4e6e-b342-511587d54089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a55601-d107-4e6e-b342-511587d54089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e4e580-739f-4293-a976-bf77a51d4b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e4e580-739f-4293-a976-bf77a51d4b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f3a0f3-7e64-4dec-8a58-3c6476af828b', 'volume_name': 'volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea1c6a-947c-41de-b0eb-87fdc3bf6361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fea1c6a-947c-41de-b0eb-87fdc3bf6361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4deea6-caf8-464e-9b86-e6b7533e2b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:04:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume 65f3a0f3-7e64-4dec-8a58-3c6476af828b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b', 'volume_size': 1} Aug 03 09:04:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=47,cinder:UPDATE=16,cinder:INSERT=16,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:04:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=51,cinder:UPDATE=21,cinder:INSERT=16,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 19.102s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.356s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2037251399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbc6d15-f8de-496f-b949-88090f9721dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:42Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume dbbc6d15-f8de-496f-b949-88090f9721dd {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:04:59 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:59 devstack sudo[109843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd 1073741824 Aug 03 09:04:59 devstack sudo[109843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:04:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2224d2c2-c791-4d06-89bc-5e8aaf93e0c3 tempest-TestVolumeBootPattern-990222927 None] Create snapshot completed successfully Aug 03 09:04:59 devstack sudo[109843]: pam_unix(sudo:session): session closed for user root Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd 1073741824" returned: 0 in 0.440s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:04:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:04:59 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd Aug 03 09:04:59 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:00 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.290s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641927083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d3b5dd3-4f09-4a33-ae6c-01a731937be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume 4d3b5dd3-4f09-4a33-ae6c-01a731937be5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:00 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee9bb10-d30c-47dd-a1d1-1c95e5236be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbc6d15-f8de-496f-b949-88090f9721dd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fec8e7-a301-4e46-9947-1da897eee22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:00 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 1073741824 Aug 03 09:05:00 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:00 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-dbbc6d15-f8de-496f-b949-88090f9721dd (dbbc6d15-f8de-496f-b949-88090f9721dd): created successfully Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fec8e7-a301-4e46-9947-1da897eee22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (c0d50509-e0d4-4d05-a9cc-de060c6afcb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c0e3e6bf-37d3-4390-9061-c51385cd6d91 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:05:00 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 1073741824" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:00 devstack sudo[109870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 Aug 03 09:05:00 devstack sudo[109870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:01 devstack sudo[109870]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1311886571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be37cbd-4ce9-49bd-a798-ce5797dbbe52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='934b4beb799c422e84cb6b328d714381',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='2eb2353abdf34ca997580903c4f9b35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Creating volume 5be37cbd-4ce9-49bd-a798-ce5797dbbe52 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61fab3-0d1c-4a38-b235-6f046affeb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:01 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 1073741824 Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8efbc7-1fa8-4656-851e-bdab17fab176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:01 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 (4d3b5dd3-4f09-4a33-ae6c-01a731937be5): created successfully Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8efbc7-1fa8-4656-851e-bdab17fab176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (f0b22918-1f8a-4e50-a0c7-f370c4f4d631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a0cb8a56-f61f-4b06-944c-88b8d7a0011b tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:05:01 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 1073741824" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:01 devstack sudo[109878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 Aug 03 09:05:01 devstack sudo[109878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-4ce7769b-03e2-4bb2-b705-5ff49455d0bf-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-4ce7769b-03e2-4bb2-b705-5ff49455d0bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-4ce7769b-03e2-4bb2-b705-5ff49455d0bf" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-4ce7769b-03e2-4bb2-b705-5ff49455d0bf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Deleting online snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] snapshot_file for this snap is: volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:01 devstack sudo[109878]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6824dbc1-34d7-4154-8849-ed8a1c3d675e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.652s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-256991295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a748a7b-9f9b-489f-bc29-eec48cdfaf75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume 5a748a7b-9f9b-489f-bc29-eec48cdfaf75 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:01 devstack sudo[109885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 1073741824 Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d773d901-0546-4a62-b212-ad6caa1a4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:01 devstack sudo[109885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a5b726-c830-4b0b-aba1-a0922174c448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Volume volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 (5be37cbd-4ce9-49bd-a798-ce5797dbbe52): created successfully Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a5b726-c830-4b0b-aba1-a0922174c448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Flow 'volume_create_manager' (f558550e-1c0d-4f2b-b6c7-ef17f81f72b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8765535f-65cb-4cc8-b8fc-066b53cd9dcc tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Created volume successfully. Aug 03 09:05:01 devstack sudo[109884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf Aug 03 09:05:01 devstack sudo[109884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:02 devstack sudo[109884]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf" returned: 0 in 0.448s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e752ae-a205-41be-9360-637b75cbe60e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:02 devstack sudo[109885]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 1073741824" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:02 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 Aug 03 09:05:02 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:02 devstack sudo[109896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b Aug 03 09:05:02 devstack sudo[109896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:02 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.035s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1922856677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd44d3db-a9a3-4afb-a609-3a020e175c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:43Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume dd44d3db-a9a3-4afb-a609-3a020e175c90 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:02 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e59d37c-a0bc-453c-b4ff-34a5dd777d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:02 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 1073741824 Aug 03 09:05:02 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8d5a21-3413-4169-a554-dea64e139b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:02 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 (5a748a7b-9f9b-489f-bc29-eec48cdfaf75): created successfully Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8d5a21-3413-4169-a554-dea64e139b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (f2ce6416-8627-4d2d-8b4d-77150dff152c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d6523b41-db94-49a3-a4de-59a415b66524 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:05:02 devstack sudo[109896]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b" returned: 0 in 0.421s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X DELETE http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/4ce7769b-03e2-4bb2-b705-5ff49455d0bf?delete_info={"file_to_merge": "volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e", "merge_target_file": null, "type": "qcow2", "volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}1de0298eb0326e5be8dc59744f6e512af61fffd26937d8330b71382f06847e03" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-727af57a-f3b8-4969-af16-09f537c9d3ac" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 07:05:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-20d46d64-c071-4d74-85a4-d7f487f2ec0a x-openstack-request-id: req-20d46d64-c071-4d74-85a4-d7f487f2ec0a {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] DELETE call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/4ce7769b-03e2-4bb2-b705-5ff49455d0bf?delete_info=%7B%22file_to_merge%22:%20%22volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223e4a21d8-e281-4749-be63-9863d10524bb%22%7D used request id req-20d46d64-c071-4d74-85a4-d7f487f2ec0a {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:05:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] status of snapshot 4ce7769b-03e2-4bb2-b705-5ff49455d0bf is still "deleting"... waiting {{(pid=88796) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 09:05:03 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 1073741824" returned: 0 in 0.567s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:03 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 Aug 03 09:05:03 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:03 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.629s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799552617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f3a0f3-7e64-4dec-8a58-3c6476af828b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fd11703f3274dea95270780fac3c154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:04:44Z,use_quota=True,user_id='e7cad0ccd2db463fab355ff1edb3397f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Creating volume 65f3a0f3-7e64-4dec-8a58-3c6476af828b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:03 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:03 devstack sudo[109922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b 1073741824 Aug 03 09:05:03 devstack sudo[109922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd690277-c967-4517-a460-e67fca0b940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd44d3db-a9a3-4afb-a609-3a020e175c90', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c58b86-61b4-45f9-b9be-caaedab783c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 (dd44d3db-a9a3-4afb-a609-3a020e175c90): created successfully Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c58b86-61b4-45f9-b9be-caaedab783c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (08f0fd43-62e7-4ace-9849-d48ec0517c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-026ba7c6-f33b-4a10-89cc-e5b06d4d7ed6 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2a1c4b42-ffc8-4716-aae3-de394852bfdb req-65bcab43-942d-4972-bc9c-1ea4dceaeb14 tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:03 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b Aug 03 09:05:03 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:03 devstack sudo[109922]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b 1073741824" returned: 0 in 0.470s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:04 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b Aug 03 09:05:04 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:04 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.237a153d-3e39-4180-98f7-8f07bd1b528b" returned: 0 in 0.283s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-4ce7769b-03e2-4bb2-b705-5ff49455d0bf" released by "_delete_snapshot" :: held 2.504s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" released by "delete_snapshot" :: held 2.526s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:04 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Created reservations ['7492f3c3-4409-41c5-bf06-92ade3735cb8', '2a2f066e-7f30-47dd-8710-6586e6407f59', '5062c9bf-a399-4678-b2d3-95993df047d2', '46bfab6c-3e5d-477b-b7d2-c893011edd03'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2a1c4b42-ffc8-4716-aae3-de394852bfdb req-65bcab43-942d-4972-bc9c-1ea4dceaeb14 tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.448s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a4deea6-caf8-464e-9b86-e6b7533e2b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd5221-c3ea-4c21-9d1c-27bfd47dc0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-2a1c4b42-ffc8-4716-aae3-de394852bfdb req-65bcab43-942d-4972-bc9c-1ea4dceaeb14 tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Volume volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b (65f3a0f3-7e64-4dec-8a58-3c6476af828b): created successfully Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76cd5221-c3ea-4c21-9d1c-27bfd47dc0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Flow 'volume_create_manager' (38c80b03-ba04-40c9-ba2c-523035bf654f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8652ec33-8a2b-4c61-8305-2a998eae9834 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created volume successfully. Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-2a1c4b42-ffc8-4716-aae3-de394852bfdb req-65bcab43-942d-4972-bc9c-1ea4dceaeb14 tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc0040a1-4226-4bf3-8809-b4ae86cda908', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:05:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Delete snapshot completed successfully. Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-727af57a-f3b8-4969-af16-09f537c9d3ac tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-4ce7769b-03e2-4bb2-b705-5ff49455d0bf-delete_snapshot" released by "delete_snapshot" :: held 2.750s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-2a1c4b42-ffc8-4716-aae3-de394852bfdb req-65bcab43-942d-4972-bc9c-1ea4dceaeb14 tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] attachment_update completed successfully. Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-237a153d-3e39-4180-98f7-8f07bd1b528b-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-237a153d-3e39-4180-98f7-8f07bd1b528b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-237a153d-3e39-4180-98f7-8f07bd1b528b" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-237a153d-3e39-4180-98f7-8f07bd1b528b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Deleting online snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] snapshot_file for this snap is: volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81b3fb3-9707-4b06-9c9b-fc863bdda114]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:05 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf Aug 03 09:05:05 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-65f3a0f3-7e64-4dec-8a58-3c6476af828b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-65f3a0f3-7e64-4dec-8a58-3c6476af828b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:05 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9702c0-3d98-473c-bb8f-83775e49b63f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-65f3a0f3-7e64-4dec-8a58-3c6476af828b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-65f3a0f3-7e64-4dec-8a58-3c6476af828b" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b18cf4-e94b-4925-bb8e-3f0acfd62a95]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:05 devstack sudo[109953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e Aug 03 09:05:05 devstack sudo[109953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:05 devstack sudo[109954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b Aug 03 09:05:05 devstack sudo[109954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:05 devstack sudo[109953]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:05:05 devstack sudo[109954]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:05 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b Aug 03 09:05:05 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:05 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X DELETE http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/237a153d-3e39-4180-98f7-8f07bd1b528b?delete_info={"file_to_merge": "volume-3e4a21d8-e281-4749-be63-9863d10524bb", "merge_target_file": null, "type": "qcow2", "volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}a59ff777f80d8b159b4516069879b0117a9bfb5ead3493d39c6b4b5e97b0e022" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d9e05186-0086-4ee2-b823-83f427101b95" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 07:05:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0cabfd54-381f-49a2-85f7-068581a231f4 x-openstack-request-id: req-0cabfd54-381f-49a2-85f7-068581a231f4 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] DELETE call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/237a153d-3e39-4180-98f7-8f07bd1b528b?delete_info=%7B%22file_to_merge%22:%20%22volume-3e4a21d8-e281-4749-be63-9863d10524bb%22,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223e4a21d8-e281-4749-be63-9863d10524bb%22%7D used request id req-0cabfd54-381f-49a2-85f7-068581a231f4 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] status of snapshot 237a153d-3e39-4180-98f7-8f07bd1b528b is still "deleting"... waiting {{(pid=88796) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 09:05:06 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-65f3a0f3-7e64-4dec-8a58-3c6476af828b" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-65f3a0f3-7e64-4dec-8a58-3c6476af828b" released by "delete_volume" :: held 0.737s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['b2830cf6-3046-4416-b855-701662958f40', 'f8f73841-b7e2-49e9-bbd5-f8a3987af21a', '0e4c5601-974f-4e44-8787-59a9f93bf2f6', '1e5eb1bb-cb2c-4993-8190-c52c08cf7f2b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:06 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:06 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:06 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-dd44d3db-a9a3-4afb-a609-3a020e175c90-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:06 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-dd44d3db-a9a3-4afb-a609-3a020e175c90-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3a03eae8-d0f0-4fbb-89d7-2d3fc1f5bce0 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-65f3a0f3-7e64-4dec-8a58-3c6476af828b-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-dd44d3db-a9a3-4afb-a609-3a020e175c90" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-dd44d3db-a9a3-4afb-a609-3a020e175c90" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[548752f5-e1e8-4ba4-bc93-954ffca61644]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:06 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 Aug 03 09:05:06 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:07 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e Aug 03 09:05:07 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-bdd9f675-d352-41f6-8e74-3fce7540415d req-432716c0-1d20-4509-ad7d-739f2b9d722d tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Terminate volume connection completed successfully. Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-bdd9f675-d352-41f6-8e74-3fce7540415d req-432716c0-1d20-4509-ad7d-739f2b9d722d tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Deleting attachment cc0040a1-4226-4bf3-8809-b4ae86cda908. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:05:07 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:07 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90 Aug 03 09:05:07 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:07 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-237a153d-3e39-4180-98f7-8f07bd1b528b" released by "_delete_snapshot" :: held 2.506s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" released by "delete_snapshot" :: held 2.538s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:07 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Created reservations ['3ad6d132-1431-43b5-bfd1-fbc00de0c105', 'a9fc9062-f8c2-4adf-afed-aaefc2f37357', '353c99d4-525b-47d9-9e13-0fe43db8b22e', '7ba2e5b4-ef0b-46cf-aedb-f54541ab826b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dd44d3db-a9a3-4afb-a609-3a020e175c90" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-dd44d3db-a9a3-4afb-a609-3a020e175c90" released by "delete_volume" :: held 0.757s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Delete snapshot completed successfully. Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d9e05186-0086-4ee2-b823-83f427101b95 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-237a153d-3e39-4180-98f7-8f07bd1b528b-delete_snapshot" released by "delete_snapshot" :: held 2.757s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['288d50de-3e87-415e-ada2-60b4d3fe9558', '7ab82e72-9815-4428-8b6a-14e369a0261f', 'bc129b50-c38d-4b1b-91e3-1cb3b2cf1569', '65fcce05-2920-43da-b205-bdd0ee735258'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:07 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:07 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-5a748a7b-9f9b-489f-bc29-eec48cdfaf75-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-5a748a7b-9f9b-489f-bc29-eec48cdfaf75-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "cinder-5be37cbd-4ce9-49bd-a798-ce5797dbbe52-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb3f9e1-dab6-404c-8603-7ee46109a48b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "cinder-5be37cbd-4ce9-49bd-a798-ce5797dbbe52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "cinder-quobyte-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5d8ee0d8-8092-4d8f-acbb-0b02fe28f5f5 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-dd44d3db-a9a3-4afb-a609-3a020e175c90-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "cinder-quobyte-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f26042b-e10c-4220-b936-9d1eecd246da]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 Aug 03 09:05:08 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" acquired by "delete_snapshot" :: waited 0.089s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:08 devstack sudo[109999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 Aug 03 09:05:08 devstack sudo[109999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Deleting online snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e of volume 3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] snapshot_file for this snap is: volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fb5600-2855-41aa-836c-bd7d128543b9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf Aug 03 09:05:08 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75 Aug 03 09:05:08 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack sudo[109999]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" returned: 0 in 0.398s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[110013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52 Aug 03 09:05:08 devstack sudo[110013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb.4ce7769b-03e2-4bb2-b705-5ff49455d0bf" returned: 0 in 0.398s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a21d8-e281-4749-be63-9863d10524bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[342eb9df-2960-4ad2-9787-d83fe554776c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:08 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-5a748a7b-9f9b-489f-bc29-eec48cdfaf75" released by "delete_volume" :: held 0.847s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:08 devstack sudo[110013]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "cinder-quobyte-5be37cbd-4ce9-49bd-a798-ce5797dbbe52" released by "delete_volume" :: held 0.738s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:08 devstack sudo[110020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb Aug 03 09:05:08 devstack sudo[110020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['94f575ab-151b-44e6-8eac-bd1d8cf2953d', '3bf5bba8-01d8-46f5-b54c-1af4cb8bcd0f', '89929b13-b835-4de6-9a80-83649872e270', '3ebcf2dd-6325-48b0-bedd-b0bd0e246d93'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:08 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Created reservations ['42baedfd-8ba3-4d51-85ed-2f1aa591e586', '09310583-f940-454a-8d2b-bcf72ecce872', '51a94d64-5812-429a-b036-f3d01b33c9ba', '4109ca7a-2b8b-4333-a246-bb2f1a6e1108'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:09 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:09 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:09 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-4d3b5dd3-4f09-4a33-ae6c-01a731937be5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-4d3b5dd3-4f09-4a33-ae6c-01a731937be5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:09 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:09 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:09 devstack sudo[110020]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38e9fb3-6eb2-459b-aaa2-8152c57cd977]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3e4a21d8-e281-4749-be63-9863d10524bb" returned: 0 in 0.520s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:05:09 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.433s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:09 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.410s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-000cb499-9615-47ad-9478-1cf392f36b5d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-5a748a7b-9f9b-489f-bc29-eec48cdfaf75-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Deleted volume successfully. Aug 03 09:05:09 devstack sudo[110032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 Aug 03 09:05:09 devstack sudo[110032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-531695ac-70c2-4b92-8da2-a17b0f05d28c tempest-TestServerVolumeAttachScenarioOldVersion-1842145757 None] Lock "cinder-5be37cbd-4ce9-49bd-a798-ce5797dbbe52-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] REQ: curl -g -i -X DELETE http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e?delete_info={"file_to_merge": null, "merge_target_file": null, "type": "qcow2", "volume_id": "3e4a21d8-e281-4749-be63-9863d10524bb"} -H "Accept: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}0389588322c4a81c0b250d78287a04af9edb7da7d44108ea5d1301657346b39a" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62f92de7-0433-440e-8c59-60e804c7e0b1" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] RESP: [204] Connection: close Content-Type: application/json Date: Mon, 03 Aug 2026 07:05:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12e7c1d9-9566-4610-8e73-5e48391d2e95 x-openstack-request-id: req-12e7c1d9-9566-4610-8e73-5e48391d2e95 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] DELETE call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots/7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e?delete_info=%7B%22file_to_merge%22:%20null,%20%22merge_target_file%22:%20null,%20%22type%22:%20%22qcow2%22,%20%22volume_id%22:%20%223e4a21d8-e281-4749-be63-9863d10524bb%22%7D used request id req-12e7c1d9-9566-4610-8e73-5e48391d2e95 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] status of snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e is still "deleting"... waiting {{(pid=88796) _nova_assisted_vol_snap_delete /opt/stack/cinder/cinder/volume/drivers/remotefs.py:2054}} Aug 03 09:05:09 devstack sudo[110032]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" returned: 0 in 0.595s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:09 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5 Aug 03 09:05:09 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:10 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-4d3b5dd3-4f09-4a33-ae6c-01a731937be5" released by "delete_volume" :: held 0.996s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['b237351e-ac35-48e0-9f74-a6a13f3bdb3f', '8fd390f5-ecd2-47ed-95c3-d40087e16fd3', '0d71b414-ff6d-4a69-8d1f-342ad5f32d99', 'bfa14ec1-3248-4192-9fc6-a839535687d8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:10 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:10 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:10 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d77927f5-aa7d-4faa-a0e6-ccd7ccd914f4 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-4d3b5dd3-4f09-4a33-ae6c-01a731937be5-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e" released by "_delete_snapshot" :: held 2.461s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3e4a21d8-e281-4749-be63-9863d10524bb" released by "delete_snapshot" :: held 2.498s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:10 devstack cinder-volume[88796]: INFO cinder.message.api [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Creating message record for request_id = req-62f92de7-0433-440e-8c59-60e804c7e0b1 Aug 03 09:05:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e-delete_snapshot" released by "delete_snapshot" :: held 2.626s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server [None req-62f92de7-0433-440e-8c59-60e804c7e0b1 tempest-TestVolumeBootPattern-990222927 None] Exception during message handling: cinder.exception.RemoteFSException: Unable to delete snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e, status: error_deleting. Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server raise self.value Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1337, in delete_snapshot Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server self.driver.delete_snapshot(snapshot) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 2152, in delete_snapshot Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return self._delete_snapshot(snapshot) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/quobyte.py", line 160, in _delete_snapshot Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server super(QuobyteDriver, self)._delete_snapshot(snapshot) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 1373, in _delete_snapshot Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return self._delete_snapshot_online(context, Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 2016, in _delete_snapshot_online Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server self._nova_assisted_vol_snap_delete(context, snapshot, delete_info) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/remotefs.py", line 2062, in _nova_assisted_vol_snap_delete Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server raise exception.RemoteFSException(msg) Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server cinder.exception.RemoteFSException: Unable to delete snapshot 7f846343-f0dd-4ad3-aaa7-c1ddeca80e9e, status: error_deleting. Aug 03 09:05:10 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-dbbc6d15-f8de-496f-b949-88090f9721dd-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-dbbc6d15-f8de-496f-b949-88090f9721dd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-dbbc6d15-f8de-496f-b949-88090f9721dd" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-dbbc6d15-f8de-496f-b949-88090f9721dd" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c45050-cca1-47d6-8596-5cbb934fee97]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:11 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd Aug 03 09:05:11 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:11 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:11 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd Aug 03 09:05:11 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:12 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-dbbc6d15-f8de-496f-b949-88090f9721dd" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-dbbc6d15-f8de-496f-b949-88090f9721dd" released by "delete_volume" :: held 0.692s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['99ec387c-12af-4a55-8cc4-70ac878b7365', 'cad9e914-2dcf-421c-ad62-9e98fddd1525', '862adf6a-933d-4119-8ad8-96adcdb668e0', '48dcdfe7-dd89-4514-9fa8-7c5fa52b5b2f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:12 devstack sudo[110082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:12 devstack sudo[110082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:12 devstack sudo[110082]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-1bfa0ffb-149d-43aa-8367-50d7fd830c79-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-1bfa0ffb-149d-43aa-8367-50d7fd830c79-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-343a12d1-df57-47c2-b3fd-d10591a72b60 tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-dbbc6d15-f8de-496f-b949-88090f9721dd-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "cinder-quobyte-1bfa0ffb-149d-43aa-8367-50d7fd830c79" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-1bfa0ffb-149d-43aa-8367-50d7fd830c79" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f2d16c-9290-4b9d-9d7a-6137c6935b01]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:12 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 Aug 03 09:05:12 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:13 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:13 devstack sudo[110090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79 Aug 03 09:05:13 devstack sudo[110090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:13 devstack sudo[110090]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1bfa0ffb-149d-43aa-8367-50d7fd830c79" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-quobyte-1bfa0ffb-149d-43aa-8367-50d7fd830c79" released by "delete_volume" :: held 0.758s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Created reservations ['54accd91-a5f6-4cf5-aeb7-55fdc3c99f87', 'a7e9b0fd-49d5-4e69-a991-98e732ba9017', 'd3cbd41b-f371-4690-b860-9b29fcd67ef1', '9d322bf6-1ef7-494b-9fc4-136e2684c150'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:13 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:13 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:13 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:13 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Deleted volume successfully. Aug 03 09:05:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-01423cda-274f-4384-b26b-c225e796d11d tempest-CreateVolumesFromSourceVolumeTest-1141699442 None] Lock "cinder-1bfa0ffb-149d-43aa-8367-50d7fd830c79-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (0e20c8e9-fd81-4a8e-8950-f133a73fc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27beaf7-6c75-4486-9fd1-61f7c11788bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f27beaf7-6c75-4486-9fd1-61f7c11788bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-432442767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f48e393-b19d-4f46-aaf0-de8f7f39dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:17Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293ecee-4094-404f-bf25-d03737ca3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2293ecee-4094-404f-bf25-d03737ca3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aef95e-d533-4808-aa7b-d52644637527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57aef95e-d533-4808-aa7b-d52644637527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f48e393-b19d-4f46-aaf0-de8f7f39dbf1', 'volume_name': 'volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b0ce14-227e-4886-b023-60a8fffbaed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b0ce14-227e-4886-b023-60a8fffbaed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f930680-4c96-4884-8da1-fdb404be0538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Volume 6f48e393-b19d-4f46-aaf0-de8f7f39dbf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1', 'volume_size': 1} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-432442767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f48e393-b19d-4f46-aaf0-de8f7f39dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:17Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Creating volume 6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:17 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:17 devstack sudo[110098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 1073741824 Aug 03 09:05:17 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:17 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 1073741824" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:17 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:17 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:17 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f930680-4c96-4884-8da1-fdb404be0538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687932f6-8c45-49b5-873e-4b5cc3bce46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:17 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Volume volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 (6f48e393-b19d-4f46-aaf0-de8f7f39dbf1): created successfully Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687932f6-8c45-49b5-873e-4b5cc3bce46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:17 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (0e20c8e9-fd81-4a8e-8950-f133a73fc65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-978b860f-62bc-4778-9ce2-e621ddcf2284 tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot 8a9ef5aa-7234-4788-8be9-0c642694419c of volume 6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c24ed2-df12-406f-985c-396062d79d7d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:19 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:19 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:19 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:19 devstack sudo[110114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c 1G Aug 03 09:05:19 devstack sudo[110114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:20 devstack sudo[110114]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c 1G" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:20 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:20 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:20 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c is being set with open permissions: ugo+rw Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:20 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:20 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:20 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:20 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info Aug 03 09:05:20 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:21 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info is being set with open permissions: ugo+rw Aug 03 09:05:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:21 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info Aug 03 09:05:21 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:21 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.info" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.086s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64ffd354-5b38-484f-aa76-a22a1d6f09a6 tempest-VolumeDependencyTests-1422439792 None] Create snapshot completed successfully Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (12199ab2-dba8-4853-9ae9-5d9ec83df960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc98fd-3ad0-42b5-b088-09ed5cb1127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fc98fd-3ad0-42b5-b088-09ed5cb1127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-965528697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a4c31c-134b-40b4-a369-ede5bb64c36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a9ef5aa-7234-4788-8be9-0c642694419c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:23Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a2588-04aa-41f6-ae2f-73d6e7b7dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a2588-04aa-41f6-ae2f-73d6e7b7dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6a6fb2-6b01-4f2c-8607-632c64518227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6a6fb2-6b01-4f2c-8607-632c64518227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '63a4c31c-134b-40b4-a369-ede5bb64c36f', 'volume_name': 'volume-63a4c31c-134b-40b4-a369-ede5bb64c36f', 'volume_size': 1, 'snapshot_id': '8a9ef5aa-7234-4788-8be9-0c642694419c'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f603454-eb95-4b34-b30d-79c5fd18f42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f603454-eb95-4b34-b30d-79c5fd18f42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5140fd1-391b-404d-b7c0-2ac559cb93ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Volume 63a4c31c-134b-40b4-a369-ede5bb64c36f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-63a4c31c-134b-40b4-a369-ede5bb64c36f', 'volume_size': 1, 'snapshot_id': '8a9ef5aa-7234-4788-8be9-0c642694419c'} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c-63a4c31c-134b-40b4-a369-ede5bb64c36f" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c-63a4c31c-134b-40b4-a369-ede5bb64c36f" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Creating volume 63a4c31c-134b-40b4-a369-ede5bb64c36f from snapshot 8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] snapshot: 8a9ef5aa-7234-4788-8be9-0c642694419c, volume: 63a4c31c-134b-40b4-a369-ede5bb64c36f, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e15af1-c39f-44f3-9c86-d6010d1b9b44]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (8c28a307-d073-4938-87d3-48af742f4afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300bbd90-8ad6-44d8-a99b-12f43f9df9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (300bbd90-8ad6-44d8-a99b-12f43f9df9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82422575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142eb633-2142-4a86-bbd6-0d4e0bc19080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:23Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baa0ff3-21cc-47f6-b2c3-e027a68b7c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6baa0ff3-21cc-47f6-b2c3-e027a68b7c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ff625-8b49-4b85-92d7-01cc95ba0939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996ff625-8b49-4b85-92d7-01cc95ba0939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142eb633-2142-4a86-bbd6-0d4e0bc19080', 'volume_name': 'volume-142eb633-2142-4a86-bbd6-0d4e0bc19080', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6975b5a9-a114-48eb-8ee2-63534932614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6975b5a9-a114-48eb-8ee2-63534932614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf28b3-d51b-4c61-ae1d-d0dabf4f8d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:23 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Volume 142eb633-2142-4a86-bbd6-0d4e0bc19080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142eb633-2142-4a86-bbd6-0d4e0bc19080', 'volume_size': 1} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:23 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (7f48c228-663b-4f4a-bbf8-314aa0d7e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c3faad-9a3f-4fbc-b99e-53197761d39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c04f85-5a1c-4408-beb7-b705dbc690d1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c3faad-9a3f-4fbc-b99e-53197761d39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585746909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51525e8d-ead0-48b7-b3ab-9c0c1da70444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e449c9-9193-4d75-b4f8-62acb03ef9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e449c9-9193-4d75-b4f8-62acb03ef9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de21b4fc-906e-4936-9fc5-a6fbcd93e55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de21b4fc-906e-4936-9fc5-a6fbcd93e55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51525e8d-ead0-48b7-b3ab-9c0c1da70444', 'volume_name': 'volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec1a834-76ab-4966-b407-a07d8c10b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec1a834-76ab-4966-b407-a07d8c10b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17e84f0-08af-4d74-86e1-e77bd7d05487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Volume 51525e8d-ead0-48b7-b3ab-9c0c1da70444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444', 'volume_size': 1} Aug 03 09:05:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:23 devstack sudo[110141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:23 devstack sudo[110141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (e64b2cb4-3ef6-4dc9-886a-5037cffafcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c110434-d956-4ae3-a9c2-834bbf7918ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c110434-d956-4ae3-a9c2-834bbf7918ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088568625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d58123f-9004-46e5-8bf6-43943e4c62c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596772fd-9135-4f19-99b9-9c7c12ecbe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (596772fd-9135-4f19-99b9-9c7c12ecbe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b7159d-2a10-4944-91bf-bbb7c66e44f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b7159d-2a10-4944-91bf-bbb7c66e44f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d58123f-9004-46e5-8bf6-43943e4c62c1', 'volume_name': 'volume-0d58123f-9004-46e5-8bf6-43943e4c62c1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7be7b13-b249-4cd9-83d1-e38b0f10d139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7be7b13-b249-4cd9-83d1-e38b0f10d139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b7c4ef-a851-4d0f-9381-9e85909e25c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Volume 0d58123f-9004-46e5-8bf6-43943e4c62c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d58123f-9004-46e5-8bf6-43943e4c62c1', 'volume_size': 1} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:24 devstack sudo[110141]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.428s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:24 devstack sudo[110146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:24 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (1e21989a-293b-4c08-a071-b41f446cd896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58de9953-dbec-45d3-976d-f3228b86892b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58de9953-dbec-45d3-976d-f3228b86892b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505008939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4266f0e-5fcf-482c-864a-bc4dacbba559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde9e272-444a-476d-b35b-ecf5236d8c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde9e272-444a-476d-b35b-ecf5236d8c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f6ffa9-987a-4d59-991f-4a249658c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93f6ffa9-987a-4d59-991f-4a249658c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4266f0e-5fcf-482c-864a-bc4dacbba559', 'volume_name': 'volume-f4266f0e-5fcf-482c-864a-bc4dacbba559', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a36fb7-e440-40dd-b946-a892f2ccfb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a36fb7-e440-40dd-b946-a892f2ccfb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0121df11-6d6e-4468-a4dc-49bcad6366ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Volume f4266f0e-5fcf-482c-864a-bc4dacbba559: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4266f0e-5fcf-482c-864a-bc4dacbba559', 'volume_size': 1} Aug 03 09:05:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (6ca855b2-daa5-4073-a1c1-de5f456bd411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cfb773-459a-4c8d-9ab7-cfdc8dc4f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cfb773-459a-4c8d-9ab7-cfdc8dc4f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357243217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e1afa1-ad72-4e87-b637-b8e56160dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:25Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c92a0a0-9e28-4cf6-b9e4-241786face1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c92a0a0-9e28-4cf6-b9e4-241786face1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de9a64d-3834-40cf-8863-43b97050ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de9a64d-3834-40cf-8863-43b97050ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e1afa1-ad72-4e87-b637-b8e56160dc14', 'volume_name': 'volume-44e1afa1-ad72-4e87-b637-b8e56160dc14', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42b4cbf-8a8b-4755-b0fb-0fa6bad68c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42b4cbf-8a8b-4755-b0fb-0fa6bad68c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efadbdde-887e-46e7-9e7f-73e626428f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Volume 44e1afa1-ad72-4e87-b637-b8e56160dc14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e1afa1-ad72-4e87-b637-b8e56160dc14', 'volume_size': 1} Aug 03 09:05:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:28 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 4.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:05:28 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 233.01 MB/s Aug 03 09:05:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f is being set with open permissions: ugo+rw Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:28 devstack sudo[110160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:28 devstack sudo[110160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:28 devstack sudo[110160]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" released by "_copy_volume_from_snapshot" :: held 5.591s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c-63a4c31c-134b-40b4-a369-ede5bb64c36f" released by "_create_volume_from_snapshot" :: held 5.658s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.674s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.447s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82422575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142eb633-2142-4a86-bbd6-0d4e0bc19080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:23Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Creating volume 142eb633-2142-4a86-bbd6-0d4e0bc19080 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:28 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:28 devstack sudo[110163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 1073741824 Aug 03 09:05:28 devstack sudo[110163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5140fd1-391b-404d-b7c0-2ac559cb93ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a4c31c-134b-40b4-a369-ede5bb64c36f', 'volume_size': 1, 'snapshot_id': '8a9ef5aa-7234-4788-8be9-0c642694419c'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccadc41-aa8b-48c8-9963-a2f126182d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Volume volume-63a4c31c-134b-40b4-a369-ede5bb64c36f (63a4c31c-134b-40b4-a369-ede5bb64c36f): created successfully Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ccadc41-aa8b-48c8-9963-a2f126182d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (12199ab2-dba8-4853-9ae9-5d9ec83df960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f5c2f565-426d-42ad-bd14-383d6c557263 tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:05:29 devstack sudo[110163]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 1073741824" returned: 0 in 0.411s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:29 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 Aug 03 09:05:29 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:29 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080" returned: 0 in 0.244s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.762s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585746909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51525e8d-ead0-48b7-b3ab-9c0c1da70444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Creating volume 51525e8d-ead0-48b7-b3ab-9c0c1da70444 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:29 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 1073741824 Aug 03 09:05:29 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8cf28b3-d51b-4c61-ae1d-d0dabf4f8d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142eb633-2142-4a86-bbd6-0d4e0bc19080', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fefc1a7-dce0-44e6-a7e8-0161a76cccc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Volume volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 (142eb633-2142-4a86-bbd6-0d4e0bc19080): created successfully Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fefc1a7-dce0-44e6-a7e8-0161a76cccc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (8c28a307-d073-4938-87d3-48af742f4afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-850d941e-a189-4d9b-8033-b26fd6990ca9 tempest-CreateVolumesFromImageTest-1493037274 None] Created volume successfully. Aug 03 09:05:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:30 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 1073741824" returned: 0 in 0.489s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:30 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 Aug 03 09:05:30 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:30 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.216s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1088568625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d58123f-9004-46e5-8bf6-43943e4c62c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Creating volume 0d58123f-9004-46e5-8bf6-43943e4c62c1 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17e84f0-08af-4d74-86e1-e77bd7d05487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:30 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 1073741824 Aug 03 09:05:30 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60fd47e-0639-43ef-a523-61090ec7baa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Volume volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 (51525e8d-ead0-48b7-b3ab-9c0c1da70444): created successfully Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60fd47e-0639-43ef-a523-61090ec7baa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (7f48c228-663b-4f4a-bbf8-314aa0d7e63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bcba30bd-3034-4d3e-ac85-215303c9036e tempest-CreateVolumesFromImageTest-1493037274 None] Created volume successfully. Aug 03 09:05:30 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 1073741824" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:30 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 Aug 03 09:05:30 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:31 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1" returned: 0 in 0.236s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.524s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505008939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4266f0e-5fcf-482c-864a-bc4dacbba559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:24Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Creating volume f4266f0e-5fcf-482c-864a-bc4dacbba559 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b7c4ef-a851-4d0f-9381-9e85909e25c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d58123f-9004-46e5-8bf6-43943e4c62c1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:31 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 1073741824 Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce6407b-69e4-4930-a4b0-941899c7f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:31 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Volume volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 (0d58123f-9004-46e5-8bf6-43943e4c62c1): created successfully Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ce6407b-69e4-4930-a4b0-941899c7f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (e64b2cb4-3ef6-4dc9-886a-5037cffafcef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fedced54-aa81-4c6b-8870-f50fe9ef5667 tempest-CreateVolumesFromImageTest-1493037274 None] Created volume successfully. Aug 03 09:05:31 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 1073741824" returned: 0 in 0.441s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:31 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 Aug 03 09:05:31 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:31 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559" returned: 0 in 0.233s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.425s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357243217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e1afa1-ad72-4e87-b637-b8e56160dc14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0f52c2e07484f7aabf1154c54388dda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:25Z,use_quota=True,user_id='06800f7df02a4d508b0f0d086a5396ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Creating volume 44e1afa1-ad72-4e87-b637-b8e56160dc14 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0121df11-6d6e-4468-a4dc-49bcad6366ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4266f0e-5fcf-482c-864a-bc4dacbba559', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:31 devstack sudo[110199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 1073741824 Aug 03 09:05:31 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7fd7d8-f721-4fcb-a0fb-bb65fca4956c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Volume volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 (f4266f0e-5fcf-482c-864a-bc4dacbba559): created successfully Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7fd7d8-f721-4fcb-a0fb-bb65fca4956c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (1e21989a-293b-4c08-a071-b41f446cd896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a2efc275-0ce1-47ce-beb9-6a17d752170f tempest-CreateVolumesFromImageTest-1493037274 None] Created volume successfully. Aug 03 09:05:32 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 1073741824" returned: 0 in 0.402s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:32 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 Aug 03 09:05:32 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:32 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14" returned: 0 in 0.236s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.578s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efadbdde-887e-46e7-9e7f-73e626428f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e1afa1-ad72-4e87-b637-b8e56160dc14', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43cd560-a292-4b94-90b1-65ca4a530ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 of volume 63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:05:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Volume volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 (44e1afa1-ad72-4e87-b637-b8e56160dc14): created successfully Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43cd560-a292-4b94-90b1-65ca4a530ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Flow 'volume_create_manager' (6ca855b2-daa5-4073-a1c1-de5f456bd411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fc534c-541e-483d-be30-c7ea88fbb560]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bef23f2f-888c-46b1-97ea-ce7aaaad8e3e tempest-CreateVolumesFromImageTest-1493037274 None] Created volume successfully. Aug 03 09:05:32 devstack sudo[110208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:32 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-44e1afa1-ad72-4e87-b637-b8e56160dc14-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-44e1afa1-ad72-4e87-b637-b8e56160dc14-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-quobyte-44e1afa1-ad72-4e87-b637-b8e56160dc14" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-44e1afa1-ad72-4e87-b637-b8e56160dc14" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d5563-44ac-41f2-8720-ca6057668cc1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:32 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 Aug 03 09:05:32 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:32 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:32 devstack sudo[110215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 1G Aug 03 09:05:32 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:33 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14" returned: 0 in 0.363s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14 Aug 03 09:05:33 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:33 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 1G" returned: 0 in 0.405s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a4c31c-134b-40b4-a369-ede5bb64c36f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a4c31c-134b-40b4-a369-ede5bb64c36f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:33 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:33 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-44e1afa1-ad72-4e87-b637-b8e56160dc14" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-44e1afa1-ad72-4e87-b637-b8e56160dc14" released by "delete_volume" :: held 0.659s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Created reservations ['1aaf3994-07e0-4e10-bf1f-5d2a37e5fc28', 'c0ca67b3-07d7-45ab-b72b-d16c1b945d85', 'd529ce51-15da-4cd9-ac7a-7d482b9a7c0d', 'ce2c9ba7-fe9e-4e86-aff7-4dbc110359ed'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:33 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:33 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a4c31c-134b-40b4-a369-ede5bb64c36f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.303s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 is being set with open permissions: ugo+rw Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:33 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:33 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Deleted volume successfully. Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e808a3f6-bb5d-4200-82ee-0e8ee4d7b609 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-44e1afa1-ad72-4e87-b637-b8e56160dc14-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-f4266f0e-5fcf-482c-864a-bc4dacbba559-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-f4266f0e-5fcf-482c-864a-bc4dacbba559-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-quobyte-f4266f0e-5fcf-482c-864a-bc4dacbba559" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-f4266f0e-5fcf-482c-864a-bc4dacbba559" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:33 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9303157-805a-4ee3-95ac-a493cdd4e3b3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:33 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info Aug 03 09:05:33 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:34 devstack sudo[110237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 Aug 03 09:05:34 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:34 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:34 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info is being set with open permissions: ugo+rw Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:34 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info Aug 03 09:05:34 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:34 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:34 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559 Aug 03 09:05:34 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:34 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.info" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4fb89081-a631-4b68-9dc2-ef4e9c09173c tempest-VolumeDependencyTests-1422439792 None] Create snapshot completed successfully Aug 03 09:05:34 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f4266f0e-5fcf-482c-864a-bc4dacbba559" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-f4266f0e-5fcf-482c-864a-bc4dacbba559" released by "delete_volume" :: held 0.673s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Created reservations ['c43d0a4e-566d-4120-ba0d-aeed51051188', '682405be-060e-455d-81fb-e211d156a9f3', '195024c1-7cfc-4f4a-8598-3d137baf7cc2', 'f83a02fb-aa17-476c-b6bf-43756c7166d6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:34 devstack sudo[110251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:34 devstack sudo[110251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:34 devstack sudo[110251]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Deleted volume successfully. Aug 03 09:05:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d09cea38-b5ee-4364-a40f-593caceea57e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-f4266f0e-5fcf-482c-864a-bc4dacbba559-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-0d58123f-9004-46e5-8bf6-43943e4c62c1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-0d58123f-9004-46e5-8bf6-43943e4c62c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-quobyte-0d58123f-9004-46e5-8bf6-43943e4c62c1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-0d58123f-9004-46e5-8bf6-43943e4c62c1" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b7632e-b8bc-4cd7-8d20-6a0df3abc02f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:35 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 Aug 03 09:05:35 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:35 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:35 devstack sudo[110259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1 Aug 03 09:05:35 devstack sudo[110259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (47fecf83-47bd-4754-873e-067a9db7265c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20cf45f-bb24-4f8a-b8fd-5dd1901fd167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20cf45f-bb24-4f8a-b8fd-5dd1901fd167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1063368620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f84a5851-d9d0-4925-8498-ee28909e8bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:36Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56558397-a8d4-49d5-912c-720a4d6303fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56558397-a8d4-49d5-912c-720a4d6303fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30ffa92-f56f-406f-ba59-2de765ef2d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d30ffa92-f56f-406f-ba59-2de765ef2d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f84a5851-d9d0-4925-8498-ee28909e8bc6', 'volume_name': 'volume-f84a5851-d9d0-4925-8498-ee28909e8bc6', 'volume_size': 1, 'snapshot_id': 'c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bc73fe-d181-4306-a49f-84174a3332ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5bc73fe-d181-4306-a49f-84174a3332ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5c886-d8ed-4409-8724-47be59bd4b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Volume f84a5851-d9d0-4925-8498-ee28909e8bc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f84a5851-d9d0-4925-8498-ee28909e8bc6', 'volume_size': 1, 'snapshot_id': 'c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5'} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-f84a5851-d9d0-4925-8498-ee28909e8bc6" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-f84a5851-d9d0-4925-8498-ee28909e8bc6" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Creating volume f84a5851-d9d0-4925-8498-ee28909e8bc6 from snapshot c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] snapshot: c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5, volume: f84a5851-d9d0-4925-8498-ee28909e8bc6, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:05:35 devstack sudo[110259]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0d58123f-9004-46e5-8bf6-43943e4c62c1" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6dce8-1d6d-48db-9fe3-c8e027b57b0b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-0d58123f-9004-46e5-8bf6-43943e4c62c1" released by "delete_volume" :: held 0.732s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Created reservations ['1912f424-354c-4c4a-9b1a-573a9602513b', '41ecaf69-4f32-45bc-abc4-e65fb09dc8de', '835f02fb-b8b1-46c7-8b91-d0e3d1f1d423', '5b635c05-237f-4316-b108-95f5f661050a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:35 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:35 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:35 devstack sudo[110264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:35 devstack sudo[110264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-51525e8d-ead0-48b7-b3ab-9c0c1da70444-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:36 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.393s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63a4c31c-134b-40b4-a369-ede5bb64c36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-51525e8d-ead0-48b7-b3ab-9c0c1da70444-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f3d065-4d94-4d43-91b9-e23979175679]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:36 devstack sudo[110264]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Deleted volume successfully. Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-quobyte-51525e8d-ead0-48b7-b3ab-9c0c1da70444" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbc7ad84-96d7-453e-8fcb-de400c32b0d6 tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-0d58123f-9004-46e5-8bf6-43943e4c62c1-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-51525e8d-ead0-48b7-b3ab-9c0c1da70444" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62f6f50-7b0a-4336-9259-296e2d6e83fc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:36 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:36 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:36 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 Aug 03 09:05:36 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:36 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.377s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:36 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:36 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:36 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444" returned: 0 in 0.376s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:36 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444 Aug 03 09:05:36 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:36 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-51525e8d-ead0-48b7-b3ab-9c0c1da70444" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-51525e8d-ead0-48b7-b3ab-9c0c1da70444" released by "delete_volume" :: held 0.677s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:37 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.409s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:05:37 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:05:37 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 is being set with open permissions: ugo+rw Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Created reservations ['cc9618cb-21eb-43ab-acac-9f454d9c66b5', 'd903588e-fa68-4f58-b6d3-e82f248942a3', '65f89bee-2fdd-459d-91c6-969e64f8de47', '46bc265d-fd83-4e05-90a3-3d2d31a309d3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:37 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:37 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:37 devstack sudo[110290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:37 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:37 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" released by "_copy_volume_from_snapshot" :: held 1.525s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-f84a5851-d9d0-4925-8498-ee28909e8bc6" released by "_create_volume_from_snapshot" :: held 1.606s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.625s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:37 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-142eb633-2142-4a86-bbd6-0d4e0bc19080-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Deleted volume successfully. Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5c886-d8ed-4409-8724-47be59bd4b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f84a5851-d9d0-4925-8498-ee28909e8bc6', 'volume_size': 1, 'snapshot_id': 'c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0d9bef-9836-445f-a4db-00126e48de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-142eb633-2142-4a86-bbd6-0d4e0bc19080-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:37 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Volume volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 (f84a5851-d9d0-4925-8498-ee28909e8bc6): created successfully Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0d9bef-9836-445f-a4db-00126e48de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (47fecf83-47bd-4754-873e-067a9db7265c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-375aefc9-e3ec-436a-9191-81c52652524e tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-51525e8d-ead0-48b7-b3ab-9c0c1da70444-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "cinder-quobyte-142eb633-2142-4a86-bbd6-0d4e0bc19080" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-18180818-763e-4606-8a49-3426ea6877ea tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-142eb633-2142-4a86-bbd6-0d4e0bc19080" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f25b43-f0c5-432d-a536-6fbd382283ac]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:37 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 Aug 03 09:05:37 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:37 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:37 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080 Aug 03 09:05:37 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:38 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-142eb633-2142-4a86-bbd6-0d4e0bc19080" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-quobyte-142eb633-2142-4a86-bbd6-0d4e0bc19080" released by "delete_volume" :: held 0.689s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (35c60a97-73f1-41cb-b9dd-6157222a503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0bf1fa-e54c-4592-85bd-e1538e95ed3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0bf1fa-e54c-4592-85bd-e1538e95ed3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-605211318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc11fea0-bd1a-49d9-a6bc-bbea170b6d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f84a5851-d9d0-4925-8498-ee28909e8bc6,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:38Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8987d7-ffc8-4b3b-b04c-0497b7ae03d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe8987d7-ffc8-4b3b-b04c-0497b7ae03d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5cda98-f440-4db8-bc0b-252a2c7bc12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5cda98-f440-4db8-bc0b-252a2c7bc12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bc11fea0-bd1a-49d9-a6bc-bbea170b6d27', 'volume_name': 'volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27', 'volume_size': 1, 'source_volid': 'f84a5851-d9d0-4925-8498-ee28909e8bc6', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08966c-d184-46b8-9d66-66170ea3729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f08966c-d184-46b8-9d66-66170ea3729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06df439-ad09-44ce-be9d-1d1ce2161b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:38 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Volume bc11fea0-bd1a-49d9-a6bc-bbea170b6d27: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27', 'volume_size': 1, 'source_volid': 'f84a5851-d9d0-4925-8498-ee28909e8bc6', 'source_volstatus': 'available'} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:38 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Cloning volume f84a5851-d9d0-4925-8498-ee28909e8bc6 to volume bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Created reservations ['c89d3cec-5c48-4356-90f2-4726563b4fa3', '9cf01df4-efd1-4062-83d5-87ed5f4b87da', 'a661701f-a3ab-481d-b8f7-62beb68bb042', '31aa64ed-2f6b-439d-a171-6afd165d6196'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot 10262337-2eef-4c36-b6e8-4e66c8457b41 of volume f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff52a7b-f235-4134-b84e-a107ef727e71]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:38 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:38 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:38 devstack sudo[110303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:38 devstack sudo[110303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:38 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Deleted volume successfully. Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-595ea578-d758-4afb-8298-17686289bc8b tempest-CreateVolumesFromImageTest-1493037274 None] Lock "cinder-142eb633-2142-4a86-bbd6-0d4e0bc19080-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:38 devstack sudo[110303]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:38 devstack sudo[110311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 1G Aug 03 09:05:38 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:39 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 1G" returned: 0 in 0.454s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:39 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:39 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:39 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:39 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 is being set with open permissions: ugo+rw Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:39 devstack sudo[110321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:39 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:39 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:39 devstack sudo[110324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info Aug 03 09:05:39 devstack sudo[110324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:40 devstack sudo[110324]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:40 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info is being set with open permissions: ugo+rw Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:40 devstack sudo[110327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info Aug 03 09:05:40 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:40 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.info" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] snapshot: 10262337-2eef-4c36-b6e8-4e66c8457b41, volume: bc11fea0-bd1a-49d9-a6bc-bbea170b6d27, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e702f0-13de-4740-9fde-d709df33060a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:40 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:40 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:40 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84a5851-d9d0-4925-8498-ee28909e8bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedbcf79-c040-4fec-9cce-737759606cd3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:40 devstack sudo[110335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:40 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:41 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:41 devstack sudo[110340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 Aug 03 09:05:41 devstack sudo[110340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:41 devstack sudo[110340]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" returned: 0 in 0.565s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:05:41 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:05:41 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 is being set with open permissions: ugo+rw Aug 03 09:05:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:41 devstack sudo[110386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 Aug 03 09:05:41 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:42 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" released by "_copy_volume_from_snapshot" :: held 1.663s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-10262337-2eef-4c36-b6e8-4e66c8457b41" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-10262337-2eef-4c36-b6e8-4e66c8457b41" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot 10262337-2eef-4c36-b6e8-4e66c8457b41 of volume f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[16219989-c3d6-4700-a212-1616997bcd87]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:42 devstack sudo[110391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:42 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:42 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f84a5851-d9d0-4925-8498-ee28909e8bc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4750e6-c604-4ced-bd71-df92c9149316]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:42 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:42 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:42 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:42 devstack sudo[110402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:42 devstack sudo[110402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:43 devstack sudo[110402]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.333s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:43 devstack sudo[110409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41 Aug 03 09:05:43 devstack sudo[110409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:43 devstack sudo[110409]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6.10262337-2eef-4c36-b6e8-4e66c8457b41" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-10262337-2eef-4c36-b6e8-4e66c8457b41" released by "_delete_snapshot" :: held 1.471s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.285s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d06df439-ad09-44ce-be9d-1d1ce2161b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27', 'volume_size': 1, 'source_volid': 'f84a5851-d9d0-4925-8498-ee28909e8bc6', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2b675-8c6e-4d39-bab3-9a8cb2f699d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Volume volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 (bc11fea0-bd1a-49d9-a6bc-bbea170b6d27): created successfully Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc2b675-8c6e-4d39-bab3-9a8cb2f699d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (35c60a97-73f1-41cb-b9dd-6157222a503d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-458edbb9-395a-4ce2-a025-08270325c27d tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (964a4c6b-c4e5-4cbd-b820-68b1fda825f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184fc962-64be-4cfe-acc4-683c29d8bce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184fc962-64be-4cfe-acc4-683c29d8bce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e581c7a-a6d8-4454-baa4-eb7cfc87cb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:44Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3daa188-fedb-438e-9c82-293c0a7e1ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3daa188-fedb-438e-9c82-293c0a7e1ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23399cbe-e21b-4fdf-9473-4e460058537d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:43 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23399cbe-e21b-4fdf-9473-4e460058537d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e581c7a-a6d8-4454-baa4-eb7cfc87cb53', 'volume_name': 'volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53', 'volume_size': 1, 'image_id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccb27146f586dc5adb64f8772a0b8f3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0232505fc8b26d6bbf22534f141396fff758540151c15f1eb98df6a02a6059dbcbb7f084a293c5150ef5431b84eb8150b13b00c7c0d33ec93c22a044ccb5caac', 'id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574ae7bd-18bb-475c-8a8b-d4e0f5128398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574ae7bd-18bb-475c-8a8b-d4e0f5128398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7df1bc8-90fb-4e37-8e33-feac0f770e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53', 'volume_size': 1, 'image_id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccb27146f586dc5adb64f8772a0b8f3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0232505fc8b26d6bbf22534f141396fff758540151c15f1eb98df6a02a6059dbcbb7f084a293c5150ef5431b84eb8150b13b00c7c0d33ec93c22a044ccb5caac', 'id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12/file', 'properties': {}}, 'image_service': } Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Trying to clone 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 from image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:05:44 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[186172b4-0f4b-43de-b8a8-c1be1bf039d5]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-8a9ef5aa-7234-4788-8be9-0c642694419c-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-8a9ef5aa-7234-4788-8be9-0c642694419c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:44 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:44 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot 8a9ef5aa-7234-4788-8be9-0c642694419c of volume 6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfb525f-fbb4-40b3-bf3c-e4449efdd3f1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:44 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:44 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:44 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:44 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:44 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:44 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a075c-aea9-4a39-bc3c-481343f8c9a3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:45 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:45 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Temporary image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 is fetched for user 61d5303c9d574c8d97745dee65efdc18. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ea2189-2892-4cae-8481-922e1212ffaf]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:45 devstack sudo[110428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:45 devstack sudo[110428]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.532s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:45 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:45 devstack sudo[110435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:45 devstack sudo[110435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:45 devstack sudo[110435]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e581c7a-a6d8-4454-baa4-eb7cfc87cb53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:44Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Creating volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1073741824 Aug 03 09:05:45 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:45 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:45 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c Aug 03 09:05:45 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:46 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1.8a9ef5aa-7234-4788-8be9-0c642694419c" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-8a9ef5aa-7234-4788-8be9-0c642694419c" released by "_delete_snapshot" :: held 1.615s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" released by "delete_snapshot" :: held 1.639s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['8e5f72b1-7d35-4982-90a7-e86cd6e302f2', '64958899-c679-4c27-8f89-29c2c3a4b716', '9454ca91-a46b-4347-b70d-4ea69ca88959', 'dc553f48-ea82-4cb4-ae93-9abadb639d81'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:46 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1073741824" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Delete snapshot completed successfully. Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0f635797-5dd8-44fb-8041-c731628c8b57 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-8a9ef5aa-7234-4788-8be9-0c642694419c-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:46 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 Aug 03 09:05:46 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:46 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Attempting download of f978d671-9d75-4ebd-82cd-bd1cb3f27d12 ((None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}])) to volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4986e47-1c27-42fa-b905-f6822c8c9ba3]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_ {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 of volume 63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b23773-7a49-4757-9e69-3b087d6ff3fa]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:46 devstack sudo[110457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_ Aug 03 09:05:46 devstack sudo[110457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:46 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:46 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack sudo[110457]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_ {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63a4c31c-134b-40b4-a369-ede5bb64c36f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:47 devstack sudo[110463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_ Aug 03 09:05:47 devstack sudo[110463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[334b75da-de1b-41ea-8731-c511cda93d6e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:47 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack sudo[110463]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_" returned: 1 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_ki_fmhh_' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22c5e83-c630-4b5a-bd15-4a4965250521]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:47 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:47 devstack sudo[110477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD Aug 03 09:05:47 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:47 devstack sudo[110477]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:47 devstack sudo[110486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5 Aug 03 09:05:47 devstack sudo[110486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:48 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] f978d671-9d75-4ebd-82cd-bd1cb3f27d12 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:48 devstack sudo[110491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 Aug 03 09:05:48 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:48 devstack sudo[110486]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f.c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5" released by "_delete_snapshot" :: held 1.440s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" released by "delete_snapshot" :: held 1.461s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Created reservations ['59be2807-f95e-4136-a360-64bd5e82ef6c', '97faa212-597a-4e2d-a56b-3c4f64c03565', 'cec8c519-201c-4ba8-9a48-271dfe06d84d', '06671213-69df-4d6c-8591-cb359b383aec'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Delete snapshot completed successfully. Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d8a0d45a-8dda-46cf-9398-e6e0f8d1f19a tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-c3bc4ee2-7c1a-4109-b081-ff5dc56e90f5-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:48 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" returned: 0 in 0.434s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f978d671-9d75-4ebd-82cd-bd1cb3f27d12_dkjjvm6sdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:05:48 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:48 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1G Aug 03 09:05:48 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:48 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 1G" returned: 0 in 0.299s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Downloaded image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 ((None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}])) to volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Temporary image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 for user 61d5303c9d574c8d97745dee65efdc18 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Marking volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Copying metadata from image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 to 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Creating volume glance metadata for volume 6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 backed by image f978d671-9d75-4ebd-82cd-bd1cb3f27d12 with: {'image_id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ccb27146f586dc5adb64f8772a0b8f3d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-f84a5851-d9d0-4925-8498-ee28909e8bc6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-f84a5851-d9d0-4925-8498-ee28909e8bc6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7df1bc8-90fb-4e37-8e33-feac0f770e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53', 'volume_size': 1, 'image_id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ccb27146f586dc5adb64f8772a0b8f3d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0232505fc8b26d6bbf22534f141396fff758540151c15f1eb98df6a02a6059dbcbb7f084a293c5150ef5431b84eb8150b13b00c7c0d33ec93c22a044ccb5caac', 'id': 'f978d671-9d75-4ebd-82cd-bd1cb3f27d12', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f978d671-9d75-4ebd-82cd-bd1cb3f27d12/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa43ca8-074b-4040-a417-d5b01384eb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Volume volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 (6e581c7a-a6d8-4454-baa4-eb7cfc87cb53): created successfully Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa43ca8-074b-4040-a417-d5b01384eb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (964a4c6b-c4e5-4cbd-b820-68b1fda825f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-68d03704-eb56-4557-b8df-3376d9ae8444 tempest-VolumeImageDependencyTests-925122951 None] Created volume successfully. Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f9ddb-5be7-4aa4-850c-ef6a6b9ec126]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:49 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:49 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:49 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efc81a-cebe-43b9-8c34-bb5af3c92b24]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:49 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6 Aug 03 09:05:49 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:49 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 Aug 03 09:05:49 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:49 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f84a5851-d9d0-4925-8498-ee28909e8bc6" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-f84a5851-d9d0-4925-8498-ee28909e8bc6" released by "delete_volume" :: held 0.693s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Created reservations ['106da7c6-7274-47e3-acda-641140ec4cf4', '28ca8f7e-564b-4e30-b6fc-2a8a999a0a91', 'c18eeabf-e279-4d39-8c4d-0c213b8a544e', '9df71ac3-8d7e-4a5b-b4a5-345e12f9c56a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:49 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:49 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53 Aug 03 09:05:49 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:49 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:49 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:50 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:50 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53" released by "delete_volume" :: held 0.709s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-92c30cd9-de0a-4d2b-b00f-e6d0788a22fe tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-f84a5851-d9d0-4925-8498-ee28909e8bc6-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['0fb17f5e-117a-4b8f-ae08-06ed0567fcf2', '0dd6442f-795f-4417-83f9-5eb89e97a56e', 'f8f9d1d3-347f-4fc0-8de4-3cdd78c6251f', 'da2b73e0-d4a4-42c6-86b9-cf1998d3a2c6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6490fa6-7e60-40e5-b2f4-78ee88d35054]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:50 devstack sudo[110524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:50 devstack sudo[110524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:50 devstack sudo[110523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:50 devstack sudo[110523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:50 devstack sudo[110524]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Deleted volume successfully. Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0ed9a246-e83b-4f7d-9630-8d33fd565aa9 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-6e581c7a-a6d8-4454-baa4-eb7cfc87cb53-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:50 devstack sudo[110523]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:50 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1 Aug 03 09:05:50 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:50 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1" released by "delete_volume" :: held 0.727s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Created reservations ['afed24b0-e9d5-455e-82e6-9f6dcad73da4', 'ea0ccc78-f72d-402c-bd89-2d25eef289db', 'abc594ed-033d-435b-8ff0-a0aa1baab571', '4eedc217-48bf-4144-b187-7bec681a8b95'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:51 devstack sudo[110535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:51 devstack sudo[110535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-63a4c31c-134b-40b4-a369-ede5bb64c36f-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-63a4c31c-134b-40b4-a369-ede5bb64c36f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:51 devstack sudo[110535]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.299s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4f4d9a3e-8402-4ca9-8da8-67619acf0ccc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-6f48e393-b19d-4f46-aaf0-de8f7f39dbf1-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[231a1b93-88f7-4459-9534-0cebb32ef50c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:51 devstack sudo[110538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:51 devstack sudo[110538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:51 devstack sudo[110538]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:51 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f Aug 03 09:05:51 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:51 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-63a4c31c-134b-40b4-a369-ede5bb64c36f" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-63a4c31c-134b-40b4-a369-ede5bb64c36f" released by "delete_volume" :: held 0.687s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['9d9d25db-6525-4121-baea-9d5dab09b383', 'a4475ff8-4f1d-483a-8030-3fd087f55d64', '8e05093b-f1d0-4734-89f2-6258ac135813', 'c8c9b539-3c27-4e47-8a1e-95b25e038b2e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:52 devstack sudo[110552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:52 devstack sudo[110552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:52 devstack sudo[110552]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.287s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-860508bf-284d-4b6a-ad1d-15806631c7c0 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-63a4c31c-134b-40b4-a369-ede5bb64c36f-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bed5dd-7bac-42b3-9416-79637daddbd0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:52 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 Aug 03 09:05:52 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:52 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:52 devstack sudo[110560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27 Aug 03 09:05:52 devstack sudo[110560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:53 devstack sudo[110560]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27" released by "delete_volume" :: held 0.692s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['6ffdb4a5-50e4-43ca-97ac-c707048bfa78', '756bf1df-0198-40b6-bdc4-8118aba33308', '78d66561-ea5e-4392-97f6-b82ef67664fd', '8226b2fd-a8f2-4596-841d-aa3711175d63'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (977ebc86-2e32-43b4-b78e-3b3cc6940397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9696dadc-2240-471a-a0a2-e4ed04f6883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9696dadc-2240-471a-a0a2-e4ed04f6883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fece8e2-226b-4449-a783-3ebbbf64d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:53Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23610f63-08f0-4c5b-b839-591b61225d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23610f63-08f0-4c5b-b839-591b61225d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797f6c66-013f-4405-853e-491d76c9e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:53 devstack sudo[110563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:05:53 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797f6c66-013f-4405-853e-491d76c9e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fece8e2-226b-4449-a783-3ebbbf64d920', 'volume_name': 'volume-3fece8e2-226b-4449-a783-3ebbbf64d920', 'volume_size': 1, 'image_id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e7e0e299840130766137e5738bbdc71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f394b7c1651708906cfc0fe5605c923e6230d2e3cb724f4082bb5f98e2bb4c6ddeea679daffed8ce169202ed188b1df7fee225eec6d9fb46fbceed95422eb5a9', 'id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99bb94b-b393-4eb6-aeef-1bb479ea1097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99bb94b-b393-4eb6-aeef-1bb479ea1097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b735a-d683-4123-ab78-d44e1dc17873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:53 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Volume 3fece8e2-226b-4449-a783-3ebbbf64d920: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fece8e2-226b-4449-a783-3ebbbf64d920', 'volume_size': 1, 'image_id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e7e0e299840130766137e5738bbdc71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f394b7c1651708906cfc0fe5605c923e6230d2e3cb724f4082bb5f98e2bb4c6ddeea679daffed8ce169202ed188b1df7fee225eec6d9fb46fbceed95422eb5a9', 'id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29/file', 'properties': {}}, 'image_service': } Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Trying to clone 3fece8e2-226b-4449-a783-3ebbbf64d920 from image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:05:53 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:05:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b7fd7ca-90b6-4288-b222-320778670928 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-bc11fea0-bd1a-49d9-a6bc-bbea170b6d27-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:05:53 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6283f7d9-7606-48dd-80b4-4e900fc9bd41]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:53 devstack sudo[110566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:53 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (4ffa7c56-591b-411f-880c-b1748fcbb37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89879308-7db9-42d6-84ce-6406c32db74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89879308-7db9-42d6-84ce-6406c32db74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1573474555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b40609-b99b-4900-8574-69f247b14b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:54Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f36fdcf-df37-48fe-af99-08507606282f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f36fdcf-df37-48fe-af99-08507606282f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0b1ccf-ccb8-4408-aa1e-b48616f15947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:54 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab0b1ccf-ccb8-4408-aa1e-b48616f15947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b40609-b99b-4900-8574-69f247b14b6c', 'volume_name': 'volume-31b40609-b99b-4900-8574-69f247b14b6c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d0d12e-d45d-4e3c-a404-9fe159578189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8d0d12e-d45d-4e3c-a404-9fe159578189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e69b57-2bdb-4a32-81c8-20570b83b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Volume 31b40609-b99b-4900-8574-69f247b14b6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b40609-b99b-4900-8574-69f247b14b6c', 'volume_size': 1} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1573474555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b40609-b99b-4900-8574-69f247b14b6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:54Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Creating volume 31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:54 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:54 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c 1073741824 Aug 03 09:05:54 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:54 devstack sudo[110571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:54 devstack sudo[110571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:54 devstack sudo[110571]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Temporary image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 is fetched for user 61d5303c9d574c8d97745dee65efdc18. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:05:54 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c 1073741824" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad1a1d8-f0cb-4e73-a044-bcdc6415b7ca]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:54 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:54 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:54 devstack sudo[110581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:05:54 devstack sudo[110581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:54 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:54 devstack sudo[110581]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e69b57-2bdb-4a32-81c8-20570b83b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b40609-b99b-4900-8574-69f247b14b6c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd0de09-0584-4f55-bfd6-3e3b8e1f479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:55 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Volume volume-31b40609-b99b-4900-8574-69f247b14b6c (31b40609-b99b-4900-8574-69f247b14b6c): created successfully Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acd0de09-0584-4f55-bfd6-3e3b8e1f479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (4ffa7c56-591b-411f-880c-b1748fcbb37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7dbdd1b1-6176-4215-9d15-4329985c2bbe tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:05:55 devstack sudo[110587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:55 devstack sudo[110587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:55 devstack sudo[110587]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fece8e2-226b-4449-a783-3ebbbf64d920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:53Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Creating volume 3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:55 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:55 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1073741824 Aug 03 09:05:55 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:55 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1073741824" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:55 devstack sudo[110597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:05:55 devstack sudo[110597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:55 devstack sudo[110597]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:05:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Attempting download of 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 ((None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}])) to volume 3fece8e2-226b-4449-a783-3ebbbf64d920. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0a38ac-c2c9-4d7f-ada7-f939292d3929]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_ {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:56 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_ Aug 03 09:05:56 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot 1b83b80a-90b5-44cc-87d6-a55053b46d21 of volume 31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d06b9-ea69-4dc5-a5ed-566cf74fdb10]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:56 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_ {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:56 devstack sudo[110602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:05:56 devstack sudo[110602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:56 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_ Aug 03 09:05:56 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:56 devstack sudo[110602]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:56 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 1G Aug 03 09:05:56 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:56 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_" returned: 1 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_wh04_lx_' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a4a3f2-ef5f-4fb8-af0d-6b0a7ee3c486]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:56 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:56 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 1G" returned: 0 in 0.393s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b40609-b99b-4900-8574-69f247b14b6c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b40609-b99b-4900-8574-69f247b14b6c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:05:57 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD Aug 03 09:05:57 devstack sudo[110624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31b40609-b99b-4900-8574-69f247b14b6c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 is being set with open permissions: ugo+rw Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:05:57 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110624]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:05:57 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.250s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=168,cinder:UPDATE=220,cinder:INSERT=66,cinder:DELETE=14 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info Aug 03 09:05:57 devstack sudo[110639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.453s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_64b1e22a-0cef-4fc1-8876-1c12a05ebd29_c49fczwsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:05:57 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110639]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info is being set with open permissions: ugo+rw Aug 03 09:05:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:57 devstack sudo[110644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1G Aug 03 09:05:57 devstack sudo[110644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:57 devstack sudo[110645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info Aug 03 09:05:57 devstack sudo[110645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:58 devstack sudo[110645]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.info" returned: 0 in 0.242s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.901s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-61c9060b-0cb5-4be2-bef7-efae3ae879ee tempest-VolumeDependencyTests-1422439792 None] Create snapshot completed successfully Aug 03 09:05:58 devstack sudo[110644]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 1G" returned: 0 in 0.323s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Downloaded image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 ((None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}])) to volume 3fece8e2-226b-4449-a783-3ebbbf64d920 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Temporary image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 for user 61d5303c9d574c8d97745dee65efdc18 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Marking volume 3fece8e2-226b-4449-a783-3ebbbf64d920 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Copying metadata from image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 to 3fece8e2-226b-4449-a783-3ebbbf64d920. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Creating volume glance metadata for volume 3fece8e2-226b-4449-a783-3ebbbf64d920 backed by image 64b1e22a-0cef-4fc1-8876-1c12a05ebd29 with: {'image_id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': '9e7e0e299840130766137e5738bbdc71', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d7b735a-d683-4123-ab78-d44e1dc17873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fece8e2-226b-4449-a783-3ebbbf64d920', 'volume_size': 1, 'image_id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9e7e0e299840130766137e5738bbdc71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f394b7c1651708906cfc0fe5605c923e6230d2e3cb724f4082bb5f98e2bb4c6ddeea679daffed8ce169202ed188b1df7fee225eec6d9fb46fbceed95422eb5a9', 'id': '64b1e22a-0cef-4fc1-8876-1c12a05ebd29', 'created_at': datetime.datetime(2026, 8, 3, 7, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 5, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/64b1e22a-0cef-4fc1-8876-1c12a05ebd29/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b314-ae80-4255-8d23-f279fa3495b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Volume volume-3fece8e2-226b-4449-a783-3ebbbf64d920 (3fece8e2-226b-4449-a783-3ebbbf64d920): created successfully Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c0b314-ae80-4255-8d23-f279fa3495b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (977ebc86-2e32-43b4-b78e-3b3cc6940397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cfc2b870-47a5-4f29-adc2-33fe6ad6f603 tempest-VolumeImageDependencyTests-925122951 None] Created volume successfully. Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (b78e60c6-da03-429c-a8d0-f0683694407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ac461-6ec3-46ff-b8cf-5eca50ea4c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (939ac461-6ec3-46ff-b8cf-5eca50ea4c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1267349943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c58caff-6dee-4b54-be00-39764cf4d585,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b83b80a-90b5-44cc-87d6-a55053b46d21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:59Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c784c318-1139-45ad-b763-0f2c9ecd1979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c784c318-1139-45ad-b763-0f2c9ecd1979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96957ccf-234e-4210-b965-65caabe8fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96957ccf-234e-4210-b965-65caabe8fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c58caff-6dee-4b54-be00-39764cf4d585', 'volume_name': 'volume-0c58caff-6dee-4b54-be00-39764cf4d585', 'volume_size': 1, 'snapshot_id': '1b83b80a-90b5-44cc-87d6-a55053b46d21'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9937fdab-0eaa-4a94-acff-60c117ab8b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9937fdab-0eaa-4a94-acff-60c117ab8b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f4246f-ab54-4155-a892-521a32dcff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Volume 0c58caff-6dee-4b54-be00-39764cf4d585: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c58caff-6dee-4b54-be00-39764cf4d585', 'volume_size': 1, 'snapshot_id': '1b83b80a-90b5-44cc-87d6-a55053b46d21'} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21-0c58caff-6dee-4b54-be00-39764cf4d585" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21-0c58caff-6dee-4b54-be00-39764cf4d585" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Creating volume 0c58caff-6dee-4b54-be00-39764cf4d585 from snapshot 1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] snapshot: 1b83b80a-90b5-44cc-87d6-a55053b46d21, volume: 0c58caff-6dee-4b54-be00-39764cf4d585, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef625153-86ae-47ff-8b4c-32015d67a326]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (7807820e-34a5-49f3-997d-334e0551326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d03acf-c620-4c83-9738-e54e8eb462a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39d03acf-c620-4c83-9738-e54e8eb462a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9048e97c-36f0-4174-8789-d84772754ea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3fece8e2-226b-4449-a783-3ebbbf64d920,status='creating',terminated_at=None,updated_at=2026-08-03T07:05:59Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4d8927-bc11-44db-adeb-814936e59f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4d8927-bc11-44db-adeb-814936e59f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5139b7c2-33d0-46eb-a949-10b0ea98b681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5139b7c2-33d0-46eb-a949-10b0ea98b681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9048e97c-36f0-4174-8789-d84772754ea0', 'volume_name': 'volume-9048e97c-36f0-4174-8789-d84772754ea0', 'volume_size': 1, 'source_volid': '3fece8e2-226b-4449-a783-3ebbbf64d920', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9541eb1a-d182-4c10-beb4-59ae5f5de7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9541eb1a-d182-4c10-beb4-59ae5f5de7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c38bde6-1797-4630-ba26-9b66af9d4b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:05:59 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Volume 9048e97c-36f0-4174-8789-d84772754ea0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9048e97c-36f0-4174-8789-d84772754ea0', 'volume_size': 1, 'source_volid': '3fece8e2-226b-4449-a783-3ebbbf64d920', 'source_volstatus': 'available'} Aug 03 09:05:59 devstack sudo[110654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:05:59 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:05:59 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b40609-b99b-4900-8574-69f247b14b6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa48ad7-8473-4306-820f-aaad98971bba]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:59 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:05:59 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:05:59 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.379s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:05:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:05:59 devstack sudo[110664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:05:59 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:03 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 4.030s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:03 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c, size 1024.00 MB, duration 4.03 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:03 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 254.03 MB/s Aug 03 09:06:03 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 is being set with open permissions: ugo+rw Aug 03 09:06:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:03 devstack sudo[110679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:03 devstack sudo[110679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:04 devstack sudo[110679]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.237s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" released by "_copy_volume_from_snapshot" :: held 5.094s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:INSERT=69,cinder:UPDATE=220,cinder:DELETE=24,cinder:SELECT=185 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21-0c58caff-6dee-4b54-be00-39764cf4d585" released by "_create_volume_from_snapshot" :: held 5.172s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.190s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.971s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:04 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Cloning volume 3fece8e2-226b-4449-a783-3ebbbf64d920 to volume 9048e97c-36f0-4174-8789-d84772754ea0 Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f4246f-ab54-4155-a892-521a32dcff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c58caff-6dee-4b54-be00-39764cf4d585', 'volume_size': 1, 'snapshot_id': '1b83b80a-90b5-44cc-87d6-a55053b46d21'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f13ca2-1449-43b1-8107-8207dab85b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Creating offline snapshot a52e30af-4d50-4be0-8bc9-50433b02dc57 of volume 3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:06:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Volume volume-0c58caff-6dee-4b54-be00-39764cf4d585 (0c58caff-6dee-4b54-be00-39764cf4d585): created successfully Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f13ca2-1449-43b1-8107-8207dab85b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (b78e60c6-da03-429c-a8d0-f0683694407c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbb613c-b516-48f9-a9b1-08e039a40c9b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3e294be1-5d59-47a2-b6cf-0ac302d9bed4 tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:06:04 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:06:04 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:04 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:04 devstack sudo[110687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 1G Aug 03 09:06:04 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:05 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 1G" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fece8e2-226b-4449-a783-3ebbbf64d920 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:05 devstack sudo[110692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fece8e2-226b-4449-a783-3ebbbf64d920 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:05 devstack sudo[110692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:05 devstack sudo[110692]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fece8e2-226b-4449-a783-3ebbbf64d920 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:05 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 is being set with open permissions: ugo+rw Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:05 devstack sudo[110697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:05 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:05 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.246s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:05 devstack sudo[110700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info Aug 03 09:06:05 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:05 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:05 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info is being set with open permissions: ugo+rw Aug 03 09:06:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:05 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info Aug 03 09:06:05 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:06 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.info" returned: 0 in 0.247s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] snapshot: a52e30af-4d50-4be0-8bc9-50433b02dc57, volume: 9048e97c-36f0-4174-8789-d84772754ea0, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb14b1d-43e4-4591-8a39-5765625dfbab]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:06 devstack sudo[110706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:06 devstack sudo[110706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:06 devstack sudo[110706]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fece8e2-226b-4449-a783-3ebbbf64d920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4de841b-fb81-40d3-b9f2-0d126bdb312e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:06 devstack sudo[110711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:06:06 devstack sudo[110711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:06 devstack sudo[110711]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:06:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:06 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 Aug 03 09:06:06 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:07 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0" returned: 0 in 0.488s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:07 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:06:07 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 is being set with open permissions: ugo+rw Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:07 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 Aug 03 09:06:07 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:07 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" released by "_copy_volume_from_snapshot" :: held 1.518s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-a52e30af-4d50-4be0-8bc9-50433b02dc57" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-a52e30af-4d50-4be0-8bc9-50433b02dc57" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Deleting offline snapshot a52e30af-4d50-4be0-8bc9-50433b02dc57 of volume 3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] snapshot_file for this snap is: volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4661ae-1f42-4692-8461-5c6815a3b254]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:07 devstack sudo[110725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:07 devstack sudo[110725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:08 devstack sudo[110725]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.360s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fece8e2-226b-4449-a783-3ebbbf64d920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c4c358-f2c5-4a7c-981b-ed37c2f935be]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:08 devstack sudo[110730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:06:08 devstack sudo[110730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:08 devstack sudo[110730]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.365s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:08 devstack sudo[110736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:08 devstack sudo[110736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:08 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:08 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:08 devstack sudo[110736]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:08 devstack sudo[110743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57 Aug 03 09:06:08 devstack sudo[110743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:08 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.242s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:06:09 devstack sudo[110743]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920.a52e30af-4d50-4be0-8bc9-50433b02dc57" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-a52e30af-4d50-4be0-8bc9-50433b02dc57" released by "_delete_snapshot" :: held 1.415s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 4.934s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Marking volume 9048e97c-36f0-4174-8789-d84772754ea0 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.571s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Copying metadata from source volume 3fece8e2-226b-4449-a783-3ebbbf64d920 to 9048e97c-36f0-4174-8789-d84772754ea0. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot 256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 of volume 0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ec1d8d-5562-456b-a786-a7630bc50ebb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c38bde6-1797-4630-ba26-9b66af9d4b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9048e97c-36f0-4174-8789-d84772754ea0', 'volume_size': 1, 'source_volid': '3fece8e2-226b-4449-a783-3ebbbf64d920', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2858abc-f84f-4bf1-adc2-1620ea5c468e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Volume volume-9048e97c-36f0-4174-8789-d84772754ea0 (9048e97c-36f0-4174-8789-d84772754ea0): created successfully Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2858abc-f84f-4bf1-adc2-1620ea5c468e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (7807820e-34a5-49f3-997d-334e0551326e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-23c517a1-c582-4c32-95ad-9e5bea59489f tempest-VolumeImageDependencyTests-925122951 None] Created volume successfully. Aug 03 09:06:09 devstack sudo[110747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:09 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:09 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.372s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:09 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 1G Aug 03 09:06:09 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-3fece8e2-226b-4449-a783-3ebbbf64d920-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-3fece8e2-226b-4449-a783-3ebbbf64d920-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-3fece8e2-226b-4449-a783-3ebbbf64d920" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-3fece8e2-226b-4449-a783-3ebbbf64d920" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:10 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6727f67-2abd-412c-946a-2239cd695f5a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 1G" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c58caff-6dee-4b54-be00-39764cf4d585 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c58caff-6dee-4b54-be00-39764cf4d585 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:10 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack sudo[110758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:06:10 devstack sudo[110758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c58caff-6dee-4b54-be00-39764cf4d585 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.318s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 is being set with open permissions: ugo+rw Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:10 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack sudo[110758]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack sudo[110771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920 Aug 03 09:06:10 devstack sudo[110771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack sudo[110771]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fece8e2-226b-4449-a783-3ebbbf64d920" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack sudo[110775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info Aug 03 09:06:10 devstack sudo[110775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-3fece8e2-226b-4449-a783-3ebbbf64d920" released by "delete_volume" :: held 0.686s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['5898ec90-c132-4ae5-bbac-25c756caa94f', '5be37395-77dc-4577-a3ed-f36c1ec1f5f6', '07f10ace-a9f4-48d1-bb5e-c0e49c72f99d', '9a9b1b7c-4cde-4921-924b-6a66bccc05d2'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:10 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:10 devstack sudo[110775]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:10 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info is being set with open permissions: ugo+rw Aug 03 09:06:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:10 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info Aug 03 09:06:10 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:11 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:11 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Deleted volume successfully. Aug 03 09:06:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-33b46e8d-98f4-4a67-8f98-084dcfb51e6f tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-3fece8e2-226b-4449-a783-3ebbbf64d920-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:11 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.info" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3c7a7081-c33a-4660-bc20-c23180ffab6a tempest-VolumeDependencyTests-1422439792 None] Create snapshot completed successfully Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (5333d8df-35a3-441b-8140-66e10254e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512ca717-bd5d-49f7-a890-a163550512db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (512ca717-bd5d-49f7-a890-a163550512db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1071868986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f0ce37-eed3-46db-9aec-a2b8e2d445bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:12Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271553e9-b5b0-45d0-a231-510af6827a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271553e9-b5b0-45d0-a231-510af6827a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc4c40e-0b73-421c-a7ea-30f5300df510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc4c40e-0b73-421c-a7ea-30f5300df510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b8f0ce37-eed3-46db-9aec-a2b8e2d445bc', 'volume_name': 'volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc', 'volume_size': 1, 'snapshot_id': '256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf06292-0929-4697-a20a-f5b6dcd94432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf06292-0929-4697-a20a-f5b6dcd94432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d1e34-af62-4338-8cb7-1c979570c960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Volume b8f0ce37-eed3-46db-9aec-a2b8e2d445bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc', 'volume_size': 1, 'snapshot_id': '256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4'} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Creating volume b8f0ce37-eed3-46db-9aec-a2b8e2d445bc from snapshot 256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] snapshot: 256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4, volume: b8f0ce37-eed3-46db-9aec-a2b8e2d445bc, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1615a823-4033-416f-8532-f024c1bf4c41]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:12 devstack sudo[110784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:12 devstack sudo[110784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:12 devstack sudo[110784]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c58caff-6dee-4b54-be00-39764cf4d585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de0f0d3-5d51-469d-a8d2-778ad80d8fe4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:13 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:13 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:13 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.376s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:13 devstack sudo[110794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc Aug 03 09:06:13 devstack sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (d4a38481-96f7-4b32-b999-127805cd0e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73c9e2-2013-4bab-afd4-c4a93b166e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73c9e2-2013-4bab-afd4-c4a93b166e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb3248-f0ab-4709-b877-4e959d354fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:14Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b6252e-9243-4a6c-8c33-a242ab745777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8b6252e-9243-4a6c-8c33-a242ab745777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:13 devstack sudo[110794]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b8238c-98ff-4c44-ae3e-6bf156e42e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" returned: 0 in 0.504s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:13 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:06:13 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc is being set with open permissions: ugo+rw Aug 03 09:06:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:13 devstack sudo[110800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc Aug 03 09:06:13 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b8238c-98ff-4c44-ae3e-6bf156e42e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2cb3248-f0ab-4709-b877-4e959d354fca', 'volume_name': 'volume-f2cb3248-f0ab-4709-b877-4e959d354fca', 'volume_size': 1, 'image_id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fb88a13c86de30d1beead94f8d33e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '122c3df2241a9258493908089245df4fdd64919ba90c7b7fca1059d2872404e5c1e42ca91a35abbe1b3a4f1939f84ca904f44269c0989578b1d733439de928ac', 'id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'created_at': datetime.datetime(2026, 8, 3, 7, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31afb19-fabb-454a-a3a4-25a0238f3f83/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be1bcf8-ead8-4a94-81d0-557f9df915cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9be1bcf8-ead8-4a94-81d0-557f9df915cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474c7d8-be82-4232-bf19-26fd553ef125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Volume f2cb3248-f0ab-4709-b877-4e959d354fca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2cb3248-f0ab-4709-b877-4e959d354fca', 'volume_size': 1, 'image_id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fb88a13c86de30d1beead94f8d33e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '122c3df2241a9258493908089245df4fdd64919ba90c7b7fca1059d2872404e5c1e42ca91a35abbe1b3a4f1939f84ca904f44269c0989578b1d733439de928ac', 'id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'created_at': datetime.datetime(2026, 8, 3, 7, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31afb19-fabb-454a-a3a4-25a0238f3f83/file', 'properties': {}}, 'image_service': } Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Trying to clone f2cb3248-f0ab-4709-b877-4e959d354fca from image e31afb19-fabb-454a-a3a4-25a0238f3f83 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:06:14 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" released by "_copy_volume_from_snapshot" :: held 1.604s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" released by "_create_volume_from_snapshot" :: held 1.670s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.687s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:06:14 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84d1e34-af62-4338-8cb7-1c979570c960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc', 'volume_size': 1, 'snapshot_id': '256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607f572d-700b-48c9-9043-e490bca7f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Volume volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc (b8f0ce37-eed3-46db-9aec-a2b8e2d445bc): created successfully Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (607f572d-700b-48c9-9043-e490bca7f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (5333d8df-35a3-441b-8140-66e10254e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2fd40d-6288-4b36-9087-36779fc11bee]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e5fd8272-0a8a-40ff-924a-500856dc17e4 tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:06:14 devstack sudo[110803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:14 devstack sudo[110803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-1b83b80a-90b5-44cc-87d6-a55053b46d21-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-1b83b80a-90b5-44cc-87d6-a55053b46d21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot 1b83b80a-90b5-44cc-87d6-a55053b46d21 of volume 31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[290edceb-114e-4de2-b4d5-c80fe9d09b21]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:14 devstack sudo[110803]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:14 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:06:14 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:14 devstack sudo[110808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:14 devstack sudo[110808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:14 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31b40609-b99b-4900-8574-69f247b14b6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:14 devstack sudo[110808]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:06:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Temporary image e31afb19-fabb-454a-a3a4-25a0238f3f83 is fetched for user 61d5303c9d574c8d97745dee65efdc18. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[915ef0ea-40e9-4d67-9768-eae03dff851c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0d73fb-6bfa-4851-9f37-328af9c40ec2]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack sudo[110817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:06:15 devstack sudo[110817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:15 devstack sudo[110818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:15 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:15 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:15 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:15 devstack sudo[110817]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.549s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack sudo[110828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:06:15 devstack sudo[110828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:15 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 1 in 0.329s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2cb3248-f0ab-4709-b877-4e959d354fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:14Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Creating volume f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:15 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1073741824 Aug 03 09:06:15 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:15 devstack sudo[110828]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:15 devstack sudo[110838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21 Aug 03 09:06:15 devstack sudo[110838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:16 devstack sudo[110838]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c.1b83b80a-90b5-44cc-87d6-a55053b46d21" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:16 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1073741824" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-1b83b80a-90b5-44cc-87d6-a55053b46d21" released by "_delete_snapshot" :: held 1.667s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" released by "delete_snapshot" :: held 1.700s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:16 devstack sudo[110844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:16 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['8213a28e-eeba-4e98-ac9a-dde87ff8f025', '30b35e58-4c94-428c-901d-430ef0f81859', '18f13e06-b701-470f-abb8-91bc95ec15a3', '051e2da5-4969-40fd-bb22-b2aaf80925fe'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Delete snapshot completed successfully. Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-65e720d7-733e-4217-a601-aaea286fd908 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-1b83b80a-90b5-44cc-87d6-a55053b46d21-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:16 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.289s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Attempting download of e31afb19-fabb-454a-a3a4-25a0238f3f83 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}])) to volume f2cb3248-f0ab-4709-b877-4e959d354fca. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1434014-61ce-45a2-8eab-af73b1728a2a]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot 256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 of volume 0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:16 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2 Aug 03 09:06:16 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[241f6d91-dfab-4bad-a965-3ef63d442a50]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:16 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:16 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:16 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2 Aug 03 09:06:17 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c58caff-6dee-4b54-be00-39764cf4d585(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c25d1-ba89-4e49-b075-74512ce601e1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:17 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2" returned: 1 in 0.325s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31afb19-fabb-454a-a3a4-25a0238f3f83_97jpxyr2' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d375dc0-d5bd-4870-afd2-00a9e45dbd6a]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:17 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.377s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:17 devstack sudo[110867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD Aug 03 09:06:17 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110867]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:17 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4 Aug 03 09:06:17 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:17 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD" returned: 1 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] e31afb19-fabb-454a-a3a4-25a0238f3f83 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:06:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:18 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:18 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:18 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585.256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4" released by "_delete_snapshot" :: held 1.414s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" released by "delete_snapshot" :: held 1.444s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['98d32d14-bf1d-437b-a9ab-c39b5739b350', '97190a90-62a5-4858-ba2c-2b355b08e384', 'e1bf4dbf-657e-49ac-80b7-c1fac943a42f', 'c93f1a4d-d55f-4aa2-bb5e-482579605397'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Delete snapshot completed successfully. Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7e6f7d0b-82f6-453d-94b5-dac618e00b68 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-256e5e1c-1a29-4ae2-8bff-24bf57c2a8b4-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:18 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.495s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e31afb19-fabb-454a-a3a4-25a0238f3f83_69h94ngudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:18 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:18 devstack sudo[110888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1G Aug 03 09:06:18 devstack sudo[110888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:18 devstack sudo[110888]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca 1G" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Downloaded image e31afb19-fabb-454a-a3a4-25a0238f3f83 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}])) to volume f2cb3248-f0ab-4709-b877-4e959d354fca successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Temporary image e31afb19-fabb-454a-a3a4-25a0238f3f83 for user 61d5303c9d574c8d97745dee65efdc18 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Marking volume f2cb3248-f0ab-4709-b877-4e959d354fca as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Copying metadata from image e31afb19-fabb-454a-a3a4-25a0238f3f83 to f2cb3248-f0ab-4709-b877-4e959d354fca. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Creating volume glance metadata for volume f2cb3248-f0ab-4709-b877-4e959d354fca backed by image e31afb19-fabb-454a-a3a4-25a0238f3f83 with: {'image_id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': '28fb88a13c86de30d1beead94f8d33e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-31b40609-b99b-4900-8574-69f247b14b6c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7474c7d8-be82-4232-bf19-26fd553ef125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2cb3248-f0ab-4709-b877-4e959d354fca', 'volume_size': 1, 'image_id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31afb19-fabb-454a-a3a4-25a0238f3f83', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28fb88a13c86de30d1beead94f8d33e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '672c779858d04657ae08fff5881afd98', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '122c3df2241a9258493908089245df4fdd64919ba90c7b7fca1059d2872404e5c1e42ca91a35abbe1b3a4f1939f84ca904f44269c0989578b1d733439de928ac', 'id': 'e31afb19-fabb-454a-a3a4-25a0238f3f83', 'created_at': datetime.datetime(2026, 8, 3, 7, 6, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 6, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31afb19-fabb-454a-a3a4-25a0238f3f83/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd93bb-794c-47c0-9ca3-b8e08dd7475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-31b40609-b99b-4900-8574-69f247b14b6c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:18 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Volume volume-f2cb3248-f0ab-4709-b877-4e959d354fca (f2cb3248-f0ab-4709-b877-4e959d354fca): created successfully Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddd93bb-794c-47c0-9ca3-b8e08dd7475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (d4a38481-96f7-4b32-b999-127805cd0e8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6052283a-7d1a-48d2-acd0-58afc9526bdb tempest-VolumeImageDependencyTests-925122951 None] Created volume successfully. Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a0f720-f6ac-4de9-bf8f-e29acc9a38e0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:19 devstack sudo[110893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:06:19 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Creating offline snapshot e26f03ca-e4b5-4cf8-8299-81e37189739c of volume f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3d65d7-2721-4698-81a2-189e16c20e3f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:19 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:19 devstack sudo[110899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c Aug 03 09:06:19 devstack sudo[110899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:19 devstack sudo[110898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:19 devstack sudo[110898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:19 devstack sudo[110899]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-31b40609-b99b-4900-8574-69f247b14b6c" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-31b40609-b99b-4900-8574-69f247b14b6c" released by "delete_volume" :: held 0.734s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:19 devstack sudo[110898]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.376s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:19 devstack sudo[110906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c 1G Aug 03 09:06:19 devstack sudo[110906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['fda95fd4-c9ad-47f9-808c-15260c6cc71b', '641e0743-ea11-4f7e-8af7-cce7597d2969', 'c9a10dee-c5a2-442b-b668-6c7e8caf0959', '3e5e0ac5-1bd3-469f-82e6-7c7e4d7958fa'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:19 devstack sudo[110908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:19 devstack sudo[110908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-0c58caff-6dee-4b54-be00-39764cf4d585-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-0c58caff-6dee-4b54-be00-39764cf4d585-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf6d622-1a09-41ca-9d92-c2668fb8833c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:20 devstack sudo[110908]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6fc26612-d25c-4e1e-9a13-441ba4c00f74 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-31b40609-b99b-4900-8574-69f247b14b6c-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:20 devstack sudo[110906]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c 1G" returned: 0 in 0.552s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb3248-f0ab-4709-b877-4e959d354fca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:20 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:20 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:20 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb3248-f0ab-4709-b877-4e959d354fca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:20 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:20 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:20 devstack sudo[110929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585 Aug 03 09:06:20 devstack sudo[110929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:20 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2cb3248-f0ab-4709-b877-4e959d354fca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c is being set with open permissions: ugo+rw Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:20 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:20 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:20 devstack sudo[110929]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c58caff-6dee-4b54-be00-39764cf4d585" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-0c58caff-6dee-4b54-be00-39764cf4d585" released by "delete_volume" :: held 0.778s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:20 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:20 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Created reservations ['e931af3b-0975-47e3-90c5-3cd05942968d', 'b297e662-01ce-4431-a611-910d263ddc21', '979127aa-a1ad-453d-8749-d27be4a60e3c', 'cb60b19b-efdf-4ad2-8ca9-9c00d2552e71'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:20 devstack sudo[110935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info Aug 03 09:06:20 devstack sudo[110935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:21 devstack sudo[110937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:21 devstack sudo[110937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:21 devstack sudo[110935]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info is being set with open permissions: ugo+rw Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:21 devstack sudo[110940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info Aug 03 09:06:21 devstack sudo[110940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:21 devstack sudo[110937]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.303s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d558330-e833-4fd4-bd0c-6f0dc2a253c2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b23b1b4d-b99d-4cfd-b525-7e143473f4ea tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-0c58caff-6dee-4b54-be00-39764cf4d585-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:21 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc Aug 03 09:06:21 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:21 devstack sudo[110940]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.info" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.238s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-dce7c825-5489-44de-8193-8ef432b8bbbd tempest-VolumeImageDependencyTests-925122951 None] Create snapshot completed successfully Aug 03 09:06:21 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:21 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc Aug 03 09:06:21 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:22 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc" released by "delete_volume" :: held 0.669s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Created reservations ['3813ba65-1120-41bf-a891-59892e1a6bce', '02426ba0-373c-43d6-9b2d-797bcb074980', 'a9ad6041-c73f-4676-9fe0-5cb885181d67', '38a8e4c7-04df-40d4-824a-cf05c64e0173'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:22 devstack sudo[110952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:22 devstack sudo[110952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:22 devstack sudo[110952]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:06:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cbf5b73c-6459-4e6a-a702-edf02e8957bc tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-b8f0ce37-eed3-46db-9aec-a2b8e2d445bc-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (54da5415-9240-4e61-a3ee-49e0376f1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d8cc41-c687-4029-9851-24f4a5dfe68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3d8cc41-c687-4029-9851-24f4a5dfe68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-920046226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e596f9-b1b3-474f-b8ac-ba51e55aaaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:23Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab62f4b7-a5b8-4176-afe7-ff4be38b0086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab62f4b7-a5b8-4176-afe7-ff4be38b0086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b7528-9ab7-4a28-be0d-31bd8dfd4d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b7528-9ab7-4a28-be0d-31bd8dfd4d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e596f9-b1b3-474f-b8ac-ba51e55aaaca', 'volume_name': 'volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23105c-b57f-4e92-afd9-e5aff4f26dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23105c-b57f-4e92-afd9-e5aff4f26dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245cb0c3-ec53-4f9d-901e-f8c7209dd940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Volume 80e596f9-b1b3-474f-b8ac-ba51e55aaaca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca', 'volume_size': 1} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-920046226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e596f9-b1b3-474f-b8ac-ba51e55aaaca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:23Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Creating volume 80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:23 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:23 devstack sudo[110957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca 1073741824 Aug 03 09:06:23 devstack sudo[110957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (003549ec-76cf-4dff-a0c2-d7184e39174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f46feba-fa3c-487c-bf68-4d1a09cfb3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f46feba-fa3c-487c-bf68-4d1a09cfb3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef162601-930a-492c-bea6-1ea9719ebb80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672c779858d04657ae08fff5881afd98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e26f03ca-e4b5-4cf8-8299-81e37189739c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:23Z,use_quota=True,user_id='61d5303c9d574c8d97745dee65efdc18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009907e7-66db-4c2e-923e-66a1cd6cf6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009907e7-66db-4c2e-923e-66a1cd6cf6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e4d77-0f42-44a5-9980-dba7b6cd9606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (517e4d77-0f42-44a5-9980-dba7b6cd9606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef162601-930a-492c-bea6-1ea9719ebb80', 'volume_name': 'volume-ef162601-930a-492c-bea6-1ea9719ebb80', 'volume_size': 1, 'snapshot_id': 'e26f03ca-e4b5-4cf8-8299-81e37189739c'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504b5a55-9aaa-47c6-b9af-e931518f3419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504b5a55-9aaa-47c6-b9af-e931518f3419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0322bbd0-7b41-4438-8c78-eb5a58dd0375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Volume ef162601-930a-492c-bea6-1ea9719ebb80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef162601-930a-492c-bea6-1ea9719ebb80', 'volume_size': 1, 'snapshot_id': 'e26f03ca-e4b5-4cf8-8299-81e37189739c'} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:23 devstack sudo[110957]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca 1073741824" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:23 devstack sudo[110962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:23 devstack sudo[110962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:23 devstack sudo[110962]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.599s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c-ef162601-930a-492c-bea6-1ea9719ebb80" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (245cb0c3-ec53-4f9d-901e-f8c7209dd940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ed463f-b5e6-4154-b4ee-82ace0ed183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c-ef162601-930a-492c-bea6-1ea9719ebb80" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Creating volume ef162601-930a-492c-bea6-1ea9719ebb80 from snapshot e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Volume volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca (80e596f9-b1b3-474f-b8ac-ba51e55aaaca): created successfully Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ed463f-b5e6-4154-b4ee-82ace0ed183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (54da5415-9240-4e61-a3ee-49e0376f1744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] snapshot: e26f03ca-e4b5-4cf8-8299-81e37189739c, volume: ef162601-930a-492c-bea6-1ea9719ebb80, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:06:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-fe01b1fc-6031-4586-9f4b-3ba05d31d855 tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[71bdfafd-119a-4857-a280-ee6bb30aaecc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:24 devstack sudo[110965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:24 devstack sudo[110965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:24 devstack sudo[110965]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2cb3248-f0ab-4709-b877-4e959d354fca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2544ab-4ac9-4d62-bbe4-55660ab9860b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:24 devstack sudo[110970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:24 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:24 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:06:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:24 devstack sudo[110975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 Aug 03 09:06:24 devstack sudo[110975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:25 devstack sudo[110975]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80" returned: 0 in 0.562s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:25 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:06:25 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 is being set with open permissions: ugo+rw Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:25 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 Aug 03 09:06:25 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:25 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" released by "_copy_volume_from_snapshot" :: held 1.657s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c-ef162601-930a-492c-bea6-1ea9719ebb80" released by "_create_volume_from_snapshot" :: held 1.732s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.763s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Marking volume ef162601-930a-492c-bea6-1ea9719ebb80 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Creating offline snapshot 249272ab-7acd-4e8e-9682-79e247b4728a of volume 80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Copying metadata from snapshot e26f03ca-e4b5-4cf8-8299-81e37189739c to ef162601-930a-492c-bea6-1ea9719ebb80. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfccd35a-8d34-4a7d-b2a5-60308b899476]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0322bbd0-7b41-4438-8c78-eb5a58dd0375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef162601-930a-492c-bea6-1ea9719ebb80', 'volume_size': 1, 'snapshot_id': 'e26f03ca-e4b5-4cf8-8299-81e37189739c'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db54bf35-9ad7-410e-991b-d179ea7a87d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Volume volume-ef162601-930a-492c-bea6-1ea9719ebb80 (ef162601-930a-492c-bea6-1ea9719ebb80): created successfully Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db54bf35-9ad7-410e-991b-d179ea7a87d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Flow 'volume_create_manager' (003549ec-76cf-4dff-a0c2-d7184e39174c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-032134d1-9064-4f05-b4c0-f9b1e114fb59 tempest-VolumeImageDependencyTests-925122951 None] Created volume successfully. Aug 03 09:06:25 devstack sudo[110984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:25 devstack sudo[110984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:26 devstack sudo[110984]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-e26f03ca-e4b5-4cf8-8299-81e37189739c-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:26 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a 1G Aug 03 09:06:26 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-e26f03ca-e4b5-4cf8-8299-81e37189739c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Deleting offline snapshot e26f03ca-e4b5-4cf8-8299-81e37189739c of volume f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] snapshot_file for this snap is: volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[498cb671-3eba-4b85-b5c5-4594083aab7b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:26 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:26 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:26 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a 1G" returned: 0 in 0.450s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:26 devstack sudo[110997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:26 devstack sudo[110997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:26 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2cb3248-f0ab-4709-b877-4e959d354fca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee71e94a-09ae-430f-be1f-22f91deb59b9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:26 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:26 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:26 devstack sudo[110997]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a is being set with open permissions: ugo+rw Aug 03 09:06:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:26 devstack sudo[111006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:26 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:27 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:27 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:27 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:27 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:27 devstack sudo[111014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info Aug 03 09:06:27 devstack sudo[111014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:27 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack sudo[111014]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info is being set with open permissions: ugo+rw Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:27 devstack sudo[111020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c Aug 03 09:06:27 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:27 devstack sudo[111021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info Aug 03 09:06:27 devstack sudo[111021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:27 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca.e26f03ca-e4b5-4cf8-8299-81e37189739c" returned: 0 in 0.242s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack sudo[111021]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.info" returned: 0 in 0.263s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-e26f03ca-e4b5-4cf8-8299-81e37189739c" released by "_delete_snapshot" :: held 1.532s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" released by "delete_snapshot" :: held 1.570s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-22f8df5f-380c-4cb5-a748-a37165e2bb23 tempest-VolumeDependencyTests-1422439792 None] Create snapshot completed successfully Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['c1ea258d-47f7-45fc-ad48-7f56a339a070', '2106e002-6445-4f49-a0eb-950f8fc3c28c', '1365aa4f-0827-4a35-9aee-f186223ac470', '886305ea-59d8-45c1-a668-0289fe48d8b9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Delete snapshot completed successfully. Aug 03 09:06:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-013d43cc-d929-4ec0-b97e-c20bfef06cb1 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-e26f03ca-e4b5-4cf8-8299-81e37189739c-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-ef162601-930a-492c-bea6-1ea9719ebb80-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-ef162601-930a-492c-bea6-1ea9719ebb80-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[16056380-41a5-412e-b557-1570d88c5216]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:28 devstack sudo[111027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 Aug 03 09:06:28 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (6f989fe2-934d-4ccb-bc70-ee7166fec518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e010df5-8e01-49e3-ade4-9eaa6084ab05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:28 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e010df5-8e01-49e3-ade4-9eaa6084ab05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-876487740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfecade-b0d4-4be3-9045-6097c7e2c69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21f1a2b216a463f8b4e901017813eb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=249272ab-7acd-4e8e-9682-79e247b4728a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:29Z,use_quota=True,user_id='8d315209817f4706ab7cec58327d929f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869f90d-7c70-4ab0-bc33-b8fa56868a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:28 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80 Aug 03 09:06:28 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6869f90d-7c70-4ab0-bc33-b8fa56868a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c42187-44b3-44cc-b4fe-f5cdc75e697e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c42187-44b3-44cc-b4fe-f5cdc75e697e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ebfecade-b0d4-4be3-9045-6097c7e2c69d', 'volume_name': 'volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d', 'volume_size': 1, 'snapshot_id': '249272ab-7acd-4e8e-9682-79e247b4728a'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33cb6da-5f7c-44e5-84f1-0411d3f1f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d33cb6da-5f7c-44e5-84f1-0411d3f1f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1711e172-6544-4de1-b491-4df17090eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Volume ebfecade-b0d4-4be3-9045-6097c7e2c69d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d', 'volume_size': 1, 'snapshot_id': '249272ab-7acd-4e8e-9682-79e247b4728a'} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a-ebfecade-b0d4-4be3-9045-6097c7e2c69d" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a-ebfecade-b0d4-4be3-9045-6097c7e2c69d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Creating volume ebfecade-b0d4-4be3-9045-6097c7e2c69d from snapshot 249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] snapshot: 249272ab-7acd-4e8e-9682-79e247b4728a, volume: ebfecade-b0d4-4be3-9045-6097c7e2c69d, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f9324c-87ce-44c0-8988-73e36d1effd7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:29 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ef162601-930a-492c-bea6-1ea9719ebb80" returned: 0 in 0.249s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-ef162601-930a-492c-bea6-1ea9719ebb80" released by "delete_volume" :: held 0.687s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:29 devstack sudo[111034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:29 devstack sudo[111034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['bf4985cb-4235-4832-9faa-7ae7535caecc', '47258553-5c8d-4fbf-901e-3d5b9c2d825b', '947f3574-7cfd-41b0-86f5-34a4a3a04bf5', '4e45cbb7-f1fd-44ea-94c3-3b2ee9a3b69a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:29 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:29 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:29 devstack sudo[111034]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4464f34e-6a04-4d45-93ce-9fad6aa7936c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:29 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Deleted volume successfully. Aug 03 09:06:29 devstack sudo[111042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:29 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c741ea-a7c9-4291-8e98-6df7a1d951ad tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-ef162601-930a-492c-bea6-1ea9719ebb80-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-f2cb3248-f0ab-4709-b877-4e959d354fca-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-f2cb3248-f0ab-4709-b877-4e959d354fca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" acquired by "delete_volume" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:29 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.437s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9366e6-e9d5-4424-8f87-18611b2405df]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:29 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d Aug 03 09:06:29 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:30 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:30 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:30 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:30 devstack sudo[111060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca Aug 03 09:06:30 devstack sudo[111060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:30 devstack sudo[111060]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f2cb3248-f0ab-4709-b877-4e959d354fca" returned: 0 in 0.642s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-f2cb3248-f0ab-4709-b877-4e959d354fca" released by "delete_volume" :: held 1.160s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['0e5116af-7375-4550-975e-9c0cf5b15a26', '1637237e-9084-4e71-af22-e04957fc2f7f', '509f753b-f0a4-4add-9a14-3ae1f8eb300e', '326bf657-578c-4fd2-9197-be4da80e24ce'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:31 devstack sudo[111069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:31 devstack sudo[111069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:31 devstack sudo[111069]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Deleted volume successfully. Aug 03 09:06:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-db868fe3-a23f-4937-9ce6-b1c2f39e5199 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-f2cb3248-f0ab-4709-b877-4e959d354fca-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-9048e97c-36f0-4174-8789-d84772754ea0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-9048e97c-36f0-4174-8789-d84772754ea0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9646bf-6d37-4486-9316-b4b95aa1d43d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:33 devstack sudo[111073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 Aug 03 09:06:33 devstack sudo[111073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:33 devstack sudo[111073]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0" returned: 0 in 0.720s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:33 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0 Aug 03 09:06:33 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:34 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9048e97c-36f0-4174-8789-d84772754ea0" returned: 0 in 0.619s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-quobyte-9048e97c-36f0-4174-8789-d84772754ea0" released by "delete_volume" :: held 1.454s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Created reservations ['421a4598-0873-4105-8716-81bc7d9ad9cb', '59543041-239c-4f83-a549-96e6fbd4d584', '4e5a12bc-f552-43ac-9064-ac56671d0355', 'a1ad399d-6896-4f5f-9566-4c08e374e346'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:34 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d" returned: 0 in 4.799s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:06:34 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Converted 1024.00 MB image at 213.30 MB/s Aug 03 09:06:34 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d is being set with open permissions: ugo+rw Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:34 devstack sudo[111081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:34 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:34 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d Aug 03 09:06:34 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:34 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Deleted volume successfully. Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7a8b635f-52a0-4bc2-b271-677c4ae45525 tempest-VolumeImageDependencyTests-925122951 None] Lock "cinder-9048e97c-36f0-4174-8789-d84772754ea0-delete_volume" released by "delete_volume" :: held 2.184s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:34 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" released by "_copy_volume_from_snapshot" :: held 5.967s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a-ebfecade-b0d4-4be3-9045-6097c7e2c69d" released by "_create_volume_from_snapshot" :: held 6.025s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.042s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1711e172-6544-4de1-b491-4df17090eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d', 'volume_size': 1, 'snapshot_id': '249272ab-7acd-4e8e-9682-79e247b4728a'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bfe53f-40c6-4cdb-b920-cdc9d6224601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Volume volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d (ebfecade-b0d4-4be3-9045-6097c7e2c69d): created successfully Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83bfe53f-40c6-4cdb-b920-cdc9d6224601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Flow 'volume_create_manager' (6f989fe2-934d-4ccb-bc70-ee7166fec518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64b6a111-2035-4448-b364-e3ce21f049ff tempest-VolumeDependencyTests-1422439792 None] Created volume successfully. Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-249272ab-7acd-4e8e-9682-79e247b4728a-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-249272ab-7acd-4e8e-9682-79e247b4728a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Deleting offline snapshot 249272ab-7acd-4e8e-9682-79e247b4728a of volume 80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] snapshot_file for this snap is: volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[594a2584-2cf7-4255-ba56-2d59b7ba0e48]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:35 devstack sudo[111087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:35 devstack sudo[111087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:36 devstack sudo[111087]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.422s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d833ee78-38b8-4bfb-89d1-feb4561064ea]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:36 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:36 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:36 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.603s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:36 devstack sudo[111098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:36 devstack sudo[111098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:37 devstack sudo[111098]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.360s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:37 devstack sudo[111104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a Aug 03 09:06:37 devstack sudo[111104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:37 devstack sudo[111104]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca.249272ab-7acd-4e8e-9682-79e247b4728a" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-249272ab-7acd-4e8e-9682-79e247b4728a" released by "_delete_snapshot" :: held 1.767s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" released by "delete_snapshot" :: held 1.792s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['7639e13a-095c-453e-b3f0-e7bb5012398b', 'ed67a988-5dac-49f7-ab6c-602c92c1d84b', '7ed7a138-9d92-42ee-af98-9c02a72ebb42', 'f5a5d1df-1098-4baa-9172-d435c2000147'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Delete snapshot completed successfully. Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-853c0d8a-442c-4954-9156-63dbfa415d22 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-249272ab-7acd-4e8e-9682-79e247b4728a-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-80e596f9-b1b3-474f-b8ac-ba51e55aaaca-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-80e596f9-b1b3-474f-b8ac-ba51e55aaaca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f74d5-8605-4ed6-9aea-62ba94382aec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:38 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:38 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:38 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:38 devstack sudo[111112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca Aug 03 09:06:38 devstack sudo[111112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:38 devstack sudo[111112]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-80e596f9-b1b3-474f-b8ac-ba51e55aaaca" released by "delete_volume" :: held 0.716s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['66aa1fb2-6133-4ea8-b654-e7f1b56eca2f', 'fbf06353-d5ef-4688-9614-3b87a757f73c', '2c48f239-aceb-4519-8a7a-bfac1d6d2675', '53df4614-f452-49f1-8ba1-9bd9da6ccce5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:38 devstack sudo[111116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:38 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:39 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-ebfecade-b0d4-4be3-9045-6097c7e2c69d-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-ebfecade-b0d4-4be3-9045-6097c7e2c69d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-6230d147-0996-4073-9e57-fe59e3196e99 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-80e596f9-b1b3-474f-b8ac-ba51e55aaaca-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d82558-f3d9-485c-9af0-3f5ce4cdd604]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:39 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d Aug 03 09:06:39 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:39 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:39 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d Aug 03 09:06:39 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:39 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ebfecade-b0d4-4be3-9045-6097c7e2c69d" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-quobyte-ebfecade-b0d4-4be3-9045-6097c7e2c69d" released by "delete_volume" :: held 0.717s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Created reservations ['13ba8db5-e688-4e6f-b23c-5524bb7b3c3b', '16cbb2b6-704d-4836-8e87-db9703bb1a04', 'deddd93b-b18f-47d4-8f63-ff882dee871c', '1b898014-ea3c-4aa2-b60f-bab9bd0c9059'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:40 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:40 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:40 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:40 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Deleted volume successfully. Aug 03 09:06:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0abf097d-faee-4f12-a3c7-79254e4eb9e7 tempest-VolumeDependencyTests-1422439792 None] Lock "cinder-ebfecade-b0d4-4be3-9045-6097c7e2c69d-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Flow 'volume_create_manager' (5d349bce-9b15-4573-b4c9-9a12148bbbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde8ea77-d3f0-44bb-b4a6-728b153648d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde8ea77-d3f0-44bb-b4a6-728b153648d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f8e4b3-d832-4347-a3cb-44ab40345148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ad3b9b447646ee93bad16ff7984c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:44Z,use_quota=True,user_id='0d1e2b484302412aafeed991cc879a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6858eb90-3a9d-4c77-89f0-c99209940374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6858eb90-3a9d-4c77-89f0-c99209940374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92098061-ccd6-40c9-a4f6-8890162fdd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92098061-ccd6-40c9-a4f6-8890162fdd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f8e4b3-d832-4347-a3cb-44ab40345148', 'volume_name': 'volume-78f8e4b3-d832-4347-a3cb-44ab40345148', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a5f592-7272-4f1d-81ce-7bd6e22ff2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a5f592-7272-4f1d-81ce-7bd6e22ff2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f78ae97-6d56-428c-8679-512c48786529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Volume 78f8e4b3-d832-4347-a3cb-44ab40345148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f8e4b3-d832-4347-a3cb-44ab40345148', 'volume_size': 1} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78f8e4b3-d832-4347-a3cb-44ab40345148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ad3b9b447646ee93bad16ff7984c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:44Z,use_quota=True,user_id='0d1e2b484302412aafeed991cc879a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Creating volume 78f8e4b3-d832-4347-a3cb-44ab40345148 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:43 devstack sudo[111167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 1073741824 Aug 03 09:06:43 devstack sudo[111167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:44 devstack sudo[111167]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 1073741824" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:44 devstack sudo[111173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 Aug 03 09:06:44 devstack sudo[111173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:44 devstack sudo[111173]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f78ae97-6d56-428c-8679-512c48786529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f8e4b3-d832-4347-a3cb-44ab40345148', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4e2aed-aae9-453d-982b-781373b6d184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Volume volume-78f8e4b3-d832-4347-a3cb-44ab40345148 (78f8e4b3-d832-4347-a3cb-44ab40345148): created successfully Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b4e2aed-aae9-453d-982b-781373b6d184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Flow 'volume_create_manager' (5d349bce-9b15-4573-b4c9-9a12148bbbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9588509e-2bc9-4744-8326-d9ec16a87446 tempest-CinderUnicodeTest-53908228 None] Created volume successfully. Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Flow 'volume_create_manager' (beee4a99-0466-489a-8473-cab4cd21af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28315ee9-2636-4fc5-ba05-086826eabc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28315ee9-2636-4fc5-ba05-086826eabc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1414006308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe06980-eb1d-488c-9201-1d4e9395304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ad3b9b447646ee93bad16ff7984c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:45Z,use_quota=True,user_id='0d1e2b484302412aafeed991cc879a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96dab0b-97f4-48bb-afa3-d9722591e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d96dab0b-97f4-48bb-afa3-d9722591e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015f7c2f-b516-488b-9bd9-1acea0cc9d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (015f7c2f-b516-488b-9bd9-1acea0cc9d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe06980-eb1d-488c-9201-1d4e9395304c', 'volume_name': 'volume-7fe06980-eb1d-488c-9201-1d4e9395304c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659bd85b-9813-45d3-9a74-a9fa607b34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (659bd85b-9813-45d3-9a74-a9fa607b34eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d69e3-d140-4b55-b218-eefe4e6f23e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Volume 7fe06980-eb1d-488c-9201-1d4e9395304c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe06980-eb1d-488c-9201-1d4e9395304c', 'volume_size': 1} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:45Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1414006308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe06980-eb1d-488c-9201-1d4e9395304c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ad3b9b447646ee93bad16ff7984c15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:45Z,use_quota=True,user_id='0d1e2b484302412aafeed991cc879a4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Creating volume 7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:45 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c 1073741824 Aug 03 09:06:45 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:45 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c 1073741824" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:45 devstack sudo[111182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c Aug 03 09:06:45 devstack sudo[111182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:46 devstack sudo[111182]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c" returned: 0 in 0.246s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0d69e3-d140-4b55-b218-eefe4e6f23e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe06980-eb1d-488c-9201-1d4e9395304c', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d574b62-c28c-41ea-8e30-aff52a9040f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Volume volume-7fe06980-eb1d-488c-9201-1d4e9395304c (7fe06980-eb1d-488c-9201-1d4e9395304c): created successfully Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d574b62-c28c-41ea-8e30-aff52a9040f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Flow 'volume_create_manager' (beee4a99-0466-489a-8473-cab4cd21af3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a5d94922-420b-4eda-8102-640effc005aa tempest-CinderUnicodeTest-53908228 None] Created volume successfully. Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Creating offline snapshot 236f9209-9746-4228-8045-39b7927b4180 of volume 7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b034c5e-32f4-4664-927c-d61684c948e4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:46 devstack sudo[111185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c Aug 03 09:06:46 devstack sudo[111185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:46 devstack sudo[111185]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c" returned: 0 in 0.362s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:47 devstack sudo[111190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 1G Aug 03 09:06:47 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:47 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 1G" returned: 0 in 0.441s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe06980-eb1d-488c-9201-1d4e9395304c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:47 devstack sudo[111195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe06980-eb1d-488c-9201-1d4e9395304c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 Aug 03 09:06:47 devstack sudo[111195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:47 devstack sudo[111195]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fe06980-eb1d-488c-9201-1d4e9395304c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:47 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 is being set with open permissions: ugo+rw Aug 03 09:06:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:47 devstack sudo[111200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 Aug 03 09:06:47 devstack sudo[111200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:47 devstack sudo[111200]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180" returned: 0 in 0.236s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:48 devstack sudo[111203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info Aug 03 09:06:48 devstack sudo[111203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:48 devstack sudo[111203]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:48 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info is being set with open permissions: ugo+rw Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:48 devstack sudo[111206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info Aug 03 09:06:48 devstack sudo[111206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:48 devstack sudo[111206]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.info" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-62cb1230-ba19-433d-84df-21693ecb36d5 tempest-CinderUnicodeTest-53908228 None] Create snapshot completed successfully Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-236f9209-9746-4228-8045-39b7927b4180-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-236f9209-9746-4228-8045-39b7927b4180-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-quobyte-236f9209-9746-4228-8045-39b7927b4180" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-236f9209-9746-4228-8045-39b7927b4180" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Deleting offline snapshot 236f9209-9746-4228-8045-39b7927b4180 of volume 7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] snapshot_file for this snap is: volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5c5644-178e-4b9d-ae71-1046dbb1fd97]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:48 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 Aug 03 09:06:48 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:49 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180" returned: 0 in 0.359s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fe06980-eb1d-488c-9201-1d4e9395304c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[226ede93-6565-4fbb-bd97-4bbc4afe5ee9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:49 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c Aug 03 09:06:49 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:49 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:49 devstack sudo[111220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 Aug 03 09:06:49 devstack sudo[111220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:49 devstack sudo[111220]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180" returned: 0 in 0.406s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:50 devstack sudo[111225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180 Aug 03 09:06:50 devstack sudo[111225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:50 devstack sudo[111225]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c.236f9209-9746-4228-8045-39b7927b4180" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-236f9209-9746-4228-8045-39b7927b4180" released by "_delete_snapshot" :: held 1.501s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" released by "delete_snapshot" :: held 1.523s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Created reservations ['1ca5caef-c089-49ce-80e7-20eb02af30be', 'e3b4130c-9ea7-4908-be1b-7dadc97e1cbf', 'a15043fb-d34f-43f5-b3e1-a927dacb6dca', '0a1d4832-4abe-4443-b22e-f822dba23f4a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Delete snapshot completed successfully. Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9017d5a5-da9f-4dca-8399-86b3b988b9f0 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-236f9209-9746-4228-8045-39b7927b4180-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-7fe06980-eb1d-488c-9201-1d4e9395304c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "cinder-7fe06980-eb1d-488c-9201-1d4e9395304c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f187957a-14f4-4777-a621-bb25fd57f6e2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:51 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c Aug 03 09:06:51 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:51 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:51 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c Aug 03 09:06:51 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:51 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7fe06980-eb1d-488c-9201-1d4e9395304c" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-7fe06980-eb1d-488c-9201-1d4e9395304c" released by "delete_volume" :: held 0.674s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Created reservations ['7cc3835f-fa8c-4467-b8b3-3d46999198d5', '58274bc7-714a-4a0f-a152-fb5bbe4ac9ce', '7539e014-430e-493d-b08c-606892d95731', 'c0037fc7-702c-4ce1-896d-166c1dd8845b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:51 devstack sudo[111236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:51 devstack sudo[111236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:52 devstack sudo[111236]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Deleted volume successfully. Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-78f8e4b3-d832-4347-a3cb-44ab40345148-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-53390333-1e96-47e5-b899-2ca6cd5876ea tempest-CinderUnicodeTest-53908228 None] Lock "cinder-7fe06980-eb1d-488c-9201-1d4e9395304c-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-78f8e4b3-d832-4347-a3cb-44ab40345148-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "cinder-quobyte-78f8e4b3-d832-4347-a3cb-44ab40345148" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-78f8e4b3-d832-4347-a3cb-44ab40345148" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b8f6a4-0591-43c7-9de5-b5fbee3b889e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:52 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 Aug 03 09:06:52 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:52 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:52 devstack sudo[111250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148 Aug 03 09:06:52 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:52 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-78f8e4b3-d832-4347-a3cb-44ab40345148" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-quobyte-78f8e4b3-d832-4347-a3cb-44ab40345148" released by "delete_volume" :: held 0.664s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Created reservations ['9cbf438a-0a0c-491f-8cef-f03efcfff0b8', 'fb95de30-34ed-44ad-86d8-cdf200af1667', '12e30113-0f79-4b34-a70f-1db39a8919d1', '8734fe44-7c2b-434a-8494-be2f04bf9c3e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:52 devstack sudo[111253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:52 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:53 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.247s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:53 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Deleted volume successfully. Aug 03 09:06:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-cb2fb15f-849e-43c3-96a6-0fa285bb7795 tempest-CinderUnicodeTest-53908228 None] Lock "cinder-78f8e4b3-d832-4347-a3cb-44ab40345148-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Flow 'volume_create_manager' (394a4596-9013-404c-afbe-cebcbe7430fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d421031-f84b-4885-bb50-ecad069c4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d421031-f84b-4885-bb50-ecad069c4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983844690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2115081-d1bd-472f-9ff2-fc05a2a73c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f60f78cd0b4e86896f21aa2ae9a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:57Z,use_quota=True,user_id='b3d100f6e6604d49bf253fb8049e34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5b91a-0e83-40cf-8d3e-315a654ebc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebf5b91a-0e83-40cf-8d3e-315a654ebc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fbd16d-752b-413d-8ae8-9740ea104feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61fbd16d-752b-413d-8ae8-9740ea104feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2115081-d1bd-472f-9ff2-fc05a2a73c12', 'volume_name': 'volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980cb884-72f4-4972-9bdb-52b5878ab745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (980cb884-72f4-4972-9bdb-52b5878ab745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d5f5fb-6378-46c6-8ed4-c87535e5a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:56 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Volume c2115081-d1bd-472f-9ff2-fc05a2a73c12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12', 'volume_size': 1} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1983844690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2115081-d1bd-472f-9ff2-fc05a2a73c12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f60f78cd0b4e86896f21aa2ae9a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:57Z,use_quota=True,user_id='b3d100f6e6604d49bf253fb8049e34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Creating volume c2115081-d1bd-472f-9ff2-fc05a2a73c12 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:56 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:56 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 1073741824 Aug 03 09:06:56 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:57 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 1073741824" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:57 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 Aug 03 09:06:57 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:57 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d5f5fb-6378-46c6-8ed4-c87535e5a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92397ed4-3e1b-4e1f-9000-66f10ed97ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:57 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Volume volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 (c2115081-d1bd-472f-9ff2-fc05a2a73c12): created successfully Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92397ed4-3e1b-4e1f-9000-66f10ed97ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Flow 'volume_create_manager' (394a4596-9013-404c-afbe-cebcbe7430fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-139b8e9d-3b0c-4f18-bfb2-be5d74f9b0a8 tempest-ProjectReaderTests-1910141325 None] Created volume successfully. Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Acquiring lock "cinder-c2115081-d1bd-472f-9ff2-fc05a2a73c12-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "cinder-c2115081-d1bd-472f-9ff2-fc05a2a73c12-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=141,cinder:UPDATE=168,cinder:INSERT=62,cinder:DELETE=11 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Acquiring lock "cinder-quobyte-c2115081-d1bd-472f-9ff2-fc05a2a73c12" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "cinder-quobyte-c2115081-d1bd-472f-9ff2-fc05a2a73c12" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af5191-1ad4-4024-8735-593a64e31429]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:06:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:57 devstack sudo[111265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 Aug 03 09:06:57 devstack sudo[111265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:58 devstack sudo[111265]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:58 devstack sudo[111270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12 Aug 03 09:06:58 devstack sudo[111270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:58 devstack sudo[111270]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c2115081-d1bd-472f-9ff2-fc05a2a73c12" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "cinder-quobyte-c2115081-d1bd-472f-9ff2-fc05a2a73c12" released by "delete_volume" :: held 0.664s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Created reservations ['99c79647-d9cc-453e-9046-833caacdc503', 'd016872d-2aad-4741-b50f-1823a7c302c5', '14fd5de5-3fa6-4026-8668-304c36294704', '67de738f-ff23-4d49-8c76-4c7230b5b560'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:58 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:06:58 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:58 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:06:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Deleted volume successfully. Aug 03 09:06:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8da81ed9-062d-4fdd-9935-ac210708555e tempest-ProjectReaderTests-1910141325 None] Lock "cinder-c2115081-d1bd-472f-9ff2-fc05a2a73c12-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Flow 'volume_create_manager' (c15adb83-cf8b-487e-bf7b-38fa00b17bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8145fa-bb67-4cc9-80fb-9bcf3595d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8145fa-bb67-4cc9-80fb-9bcf3595d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307719293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f60f78cd0b4e86896f21aa2ae9a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:59Z,use_quota=True,user_id='b3d100f6e6604d49bf253fb8049e34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1041dc6b-1fef-4707-ba28-741f292574f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1041dc6b-1fef-4707-ba28-741f292574f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057606c7-849f-4d9a-97ca-fa9f7e45925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057606c7-849f-4d9a-97ca-fa9f7e45925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207', 'volume_name': 'volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a97839-fb6a-4ab9-948d-9d66dae8b79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21a97839-fb6a-4ab9-948d-9d66dae8b79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d020c-93cb-4224-af5b-681de3c26b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:06:59 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Volume d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207', 'volume_size': 1} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-307719293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76f60f78cd0b4e86896f21aa2ae9a25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:06:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:06:59Z,use_quota=True,user_id='b3d100f6e6604d49bf253fb8049e34fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Creating volume d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:06:59 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:59 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 1073741824 Aug 03 09:06:59 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:06:59 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 1073741824" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:06:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:06:59 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 Aug 03 09:06:59 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:00 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b05d020c-93cb-4224-af5b-681de3c26b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4abd1e-24e0-4a0e-b94a-815ccbc9bec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:00 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Volume volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 (d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207): created successfully Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4abd1e-24e0-4a0e-b94a-815ccbc9bec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Flow 'volume_create_manager' (c15adb83-cf8b-487e-bf7b-38fa00b17bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:07:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-80990b74-3450-44a9-a203-a74e581574f6 tempest-ProjectReaderTests-1910141325 None] Created volume successfully. Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "cinder-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "cinder-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "cinder-quobyte-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "cinder-quobyte-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[08176da6-9b96-461e-b30a-a4656aef6d5b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:00 devstack sudo[111287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 Aug 03 09:07:00 devstack sudo[111287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:00 devstack sudo[111287]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:00 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207 Aug 03 09:07:00 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:01 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" returned: 0 in 0.244s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "cinder-quobyte-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207" released by "delete_volume" :: held 0.641s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Created reservations ['28b39833-076e-475e-b43c-62b5e10ed560', 'b27b749d-1426-4fa2-9824-bb37afe8b7f8', 'f123ef20-3a65-4e05-b12a-267883a66fb5', '737101d8-7e82-4cde-8f95-595179dbb3c3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:01 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:07:01 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:01 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:07:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Deleted volume successfully. Aug 03 09:07:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94d9b044-74e1-4998-9e0f-95715141dcb7 tempest-ProjectReaderTests-1910141325 None] Lock "cinder-d783b7d5-4bad-4e0e-8ae6-6c9e1d2c9207-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:08 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:07:08 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:09 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.247s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:07:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:07:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:07:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:07:11 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=11,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:07:11 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=167,cinder:SELECT=144,cinder:INSERT=61,cinder:DELETE=17 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Flow 'volume_create_manager' (d376cdfa-5c47-47ca-b2c4-b9b7e89a9c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bbfd-4223-4a39-a903-6c57ea29a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bbfd-4223-4a39-a903-6c57ea29a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1873855498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd9ae36-503e-491a-9ecf-53f5f702b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20af7d301b69473b9e93334a6318230c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:07:26Z,use_quota=True,user_id='726684cc88ae40dab743b71a8c823ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a63a98-6b3f-4272-ab38-ef94097f09d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a63a98-6b3f-4272-ab38-ef94097f09d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8220a22e-c6c5-46fd-a017-afb759797cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8220a22e-c6c5-46fd-a017-afb759797cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fd9ae36-503e-491a-9ecf-53f5f702b7b4', 'volume_name': 'volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe63e11-a9af-4729-abbb-52d3d3919ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe63e11-a9af-4729-abbb-52d3d3919ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693a2320-1245-4225-a927-d5b55eccc346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Volume 3fd9ae36-503e-491a-9ecf-53f5f702b7b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4', 'volume_size': 1} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:07:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1873855498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fd9ae36-503e-491a-9ecf-53f5f702b7b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20af7d301b69473b9e93334a6318230c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:07:26Z,use_quota=True,user_id='726684cc88ae40dab743b71a8c823ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Creating volume 3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:07:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:07:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:25 devstack sudo[111307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 1073741824 Aug 03 09:07:25 devstack sudo[111307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:26 devstack sudo[111307]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 1073741824" returned: 0 in 0.398s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:26 devstack sudo[111313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:26 devstack sudo[111313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:26 devstack sudo[111313]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (693a2320-1245-4225-a927-d5b55eccc346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e03ecd-938f-4d67-82c2-3a2973e7a59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Volume volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 (3fd9ae36-503e-491a-9ecf-53f5f702b7b4): created successfully Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e03ecd-938f-4d67-82c2-3a2973e7a59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Flow 'volume_create_manager' (d376cdfa-5c47-47ca-b2c4-b9b7e89a9c9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:07:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5520a12a-50c1-496c-98e9-75c9b5c484e1 tempest-SnapshotDependencyTests-497061829 None] Created volume successfully. Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Creating offline snapshot d9de21a1-3eed-4117-8e81-ed413771ce93 of volume 3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2693e490-e52b-459a-beba-2733853c7b7e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:27 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:27 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:27 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:27 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 1G Aug 03 09:07:27 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:27 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 1G" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:27 devstack sudo[111327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:27 devstack sudo[111327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:28 devstack sudo[111327]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 is being set with open permissions: ugo+rw Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:28 devstack sudo[111333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:28 devstack sudo[111333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:28 devstack sudo[111333]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.231s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:28 devstack sudo[111336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info Aug 03 09:07:28 devstack sudo[111336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:28 devstack sudo[111336]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info is being set with open permissions: ugo+rw Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:28 devstack sudo[111340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info Aug 03 09:07:28 devstack sudo[111340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:28 devstack sudo[111340]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.info" returned: 0 in 0.231s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a7555aee-c4da-475f-b5bf-e286a7c61c50 tempest-SnapshotDependencyTests-497061829 None] Create snapshot completed successfully Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Flow 'volume_create_manager' (72b29a29-ef42-4992-8bcb-c379613089e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f32a2d-8fbd-4aaa-bb0c-b60a2556fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f32a2d-8fbd-4aaa-bb0c-b60a2556fa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d28f739-6375-4e75-b077-2789db01d1d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20af7d301b69473b9e93334a6318230c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9de21a1-3eed-4117-8e81-ed413771ce93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:07:30Z,use_quota=True,user_id='726684cc88ae40dab743b71a8c823ba0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5bf4d0-c060-41d1-b5a9-0cee20e2beb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a5bf4d0-c060-41d1-b5a9-0cee20e2beb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64218546-bbae-40b2-906e-ebb9cee5ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64218546-bbae-40b2-906e-ebb9cee5ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8d28f739-6375-4e75-b077-2789db01d1d9', 'volume_name': 'volume-8d28f739-6375-4e75-b077-2789db01d1d9', 'volume_size': 1, 'snapshot_id': 'd9de21a1-3eed-4117-8e81-ed413771ce93'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01337882-6308-4f79-87a5-0fc354783dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01337882-6308-4f79-87a5-0fc354783dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd25b3e-3784-4bd6-8161-db1a41ca55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Volume 8d28f739-6375-4e75-b077-2789db01d1d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8d28f739-6375-4e75-b077-2789db01d1d9', 'volume_size': 1, 'snapshot_id': 'd9de21a1-3eed-4117-8e81-ed413771ce93'} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93-8d28f739-6375-4e75-b077-2789db01d1d9" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93-8d28f739-6375-4e75-b077-2789db01d1d9" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Creating volume 8d28f739-6375-4e75-b077-2789db01d1d9 from snapshot d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] snapshot: d9de21a1-3eed-4117-8e81-ed413771ce93, volume: 8d28f739-6375-4e75-b077-2789db01d1d9, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7983d-65f9-4142-99b7-83d282f5874f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:29 devstack sudo[111343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:29 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:30 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d92b52-a1d8-42f8-b495-623c47fa70a2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:30 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:30 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:30 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:07:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:30 devstack sudo[111354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 Aug 03 09:07:30 devstack sudo[111354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:34 devstack sudo[111354]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9" returned: 0 in 4.122s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:07:34 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Converted 1024.00 MB image at 248.30 MB/s Aug 03 09:07:34 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 is being set with open permissions: ugo+rw Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:34 devstack sudo[111368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 Aug 03 09:07:34 devstack sudo[111368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:34 devstack sudo[111368]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9" returned: 0 in 0.242s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" released by "_copy_volume_from_snapshot" :: held 5.114s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93-8d28f739-6375-4e75-b077-2789db01d1d9" released by "_create_volume_from_snapshot" :: held 5.175s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.189s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd25b3e-3784-4bd6-8161-db1a41ca55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d28f739-6375-4e75-b077-2789db01d1d9', 'volume_size': 1, 'snapshot_id': 'd9de21a1-3eed-4117-8e81-ed413771ce93'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb996c-0969-4397-94cf-fcad9cd073ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:07:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Volume volume-8d28f739-6375-4e75-b077-2789db01d1d9 (8d28f739-6375-4e75-b077-2789db01d1d9): created successfully Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10eb996c-0969-4397-94cf-fcad9cd073ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:07:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Flow 'volume_create_manager' (72b29a29-ef42-4992-8bcb-c379613089e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:07:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1fd74f0b-4355-4e49-8c4b-04b525a8d7dc tempest-SnapshotDependencyTests-497061829 None] Created volume successfully. Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-d9de21a1-3eed-4117-8e81-ed413771ce93-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-d9de21a1-3eed-4117-8e81-ed413771ce93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Deleting offline snapshot d9de21a1-3eed-4117-8e81-ed413771ce93 of volume 3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] snapshot_file for this snap is: volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e4aa32-18a0-4d93-ac62-7d9f3a23e1d2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:35 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:35 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:35 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c40eb4-3e23-4db0-9086-9265bb1de3e5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:35 devstack sudo[111376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:35 devstack sudo[111376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:36 devstack sudo[111376]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.575s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:36 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:36 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:36 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.336s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:36 devstack sudo[111386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93 Aug 03 09:07:36 devstack sudo[111386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:36 devstack sudo[111386]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4.d9de21a1-3eed-4117-8e81-ed413771ce93" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-d9de21a1-3eed-4117-8e81-ed413771ce93" released by "_delete_snapshot" :: held 1.629s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" released by "delete_snapshot" :: held 1.659s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Created reservations ['291baaac-3f03-4286-b4e4-486fcc85e6b7', '6996e559-4bd8-48d6-b604-e36cc12b2557', '855d51de-717a-44c9-922f-6cf202dd78a8', 'af42371e-30bb-4a79-93ec-78b49aca2bf6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:07:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Delete snapshot completed successfully. Aug 03 09:07:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c90bb395-298d-4616-8bbb-368e0cfeed4e tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-d9de21a1-3eed-4117-8e81-ed413771ce93-delete_snapshot" released by "delete_snapshot" :: held 1.783s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-3fd9ae36-503e-491a-9ecf-53f5f702b7b4-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-3fd9ae36-503e-491a-9ecf-53f5f702b7b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f656e87f-ff30-4d3e-9d95-486b69fd065d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:37 devstack sudo[111389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:37 devstack sudo[111389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:37 devstack sudo[111389]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:37 devstack sudo[111394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4 Aug 03 09:07:37 devstack sudo[111394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:38 devstack sudo[111394]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-3fd9ae36-503e-491a-9ecf-53f5f702b7b4" released by "delete_volume" :: held 0.656s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Created reservations ['913ba534-2238-4cd5-89f9-0a541f7a3ac0', '5a41e3b7-da8c-4b83-838a-b0f85b842cad', '4f1445f2-9708-4171-8dc0-492bca6b23f0', '5e23a3b5-4dbd-4a07-b460-a4d877590834'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:38 devstack sudo[111397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:07:38 devstack sudo[111397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:38 devstack sudo[111397]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:07:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Deleted volume successfully. Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54056ce8-877c-43d5-9ade-08f1bc2a3097 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-3fd9ae36-503e-491a-9ecf-53f5f702b7b4-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-8d28f739-6375-4e75-b077-2789db01d1d9-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-8d28f739-6375-4e75-b077-2789db01d1d9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1bd04-147e-4f6f-823a-01ca4d8fafd5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:38 devstack sudo[111401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 Aug 03 09:07:38 devstack sudo[111401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:38 devstack sudo[111401]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:38 devstack sudo[111406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9 Aug 03 09:07:38 devstack sudo[111406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:39 devstack sudo[111406]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d28f739-6375-4e75-b077-2789db01d1d9" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-quobyte-8d28f739-6375-4e75-b077-2789db01d1d9" released by "delete_volume" :: held 0.628s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Created reservations ['77b380b9-e8a4-4632-8d94-420a9376a5fe', '121d6159-8565-4873-8950-0b3e317af2ac', '0075ee39-efae-4d08-9dff-b9b58c642f4e', 'e39a30f2-096e-4c3f-8cf9-fb6845d2aace'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:07:39 devstack sudo[111409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:07:39 devstack sudo[111409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:07:39 devstack sudo[111409]: pam_unix(sudo:session): session closed for user root Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:07:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Deleted volume successfully. Aug 03 09:07:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-85508872-4230-4e6e-b37d-e2c984f97560 tempest-SnapshotDependencyTests-497061829 None] Lock "cinder-8d28f739-6375-4e75-b077-2789db01d1d9-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:07:49 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=24,cinder:INSERT=9,cinder:DELETE=4,cinder:SELECT=21 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:07:49 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=28,cinder:UPDATE=34,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:08:08 devstack sudo[111466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:08:08 devstack sudo[111466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:08:08 devstack sudo[111466]: pam_unix(sudo:session): session closed for user root Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.232s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:08:08 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:08:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:08:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:08:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:09:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:09:08 devstack sudo[111522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:09:08 devstack sudo[111522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:09:09 devstack sudo[111522]: pam_unix(sudo:session): session closed for user root Aug 03 09:09:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:09:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:09:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:09:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:09:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:10:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:10:08 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:10:08 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:10:09 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Aug 03 09:10:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:10:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:10:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:10:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:10:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:10:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:11:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:11:08 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:11:08 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:11:09 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Aug 03 09:11:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:11:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:11:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:11:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:11:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:11:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-284d6b13-7669-4924-97cb-6ff5137c8d9c req-3a0ecab6-444e-47c9-9224-5416bddc0001 tempest-TestVolumeBootPattern-990222927 None] Terminate volume connection completed successfully. Aug 03 09:11:42 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-284d6b13-7669-4924-97cb-6ff5137c8d9c req-3a0ecab6-444e-47c9-9224-5416bddc0001 tempest-TestVolumeBootPattern-990222927 None] Deleting attachment c6b536d1-c5d6-46c3-a8d2-2ecb52d00378. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:11:52 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:11:52 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:12:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:12:08 devstack sudo[111718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:12:08 devstack sudo[111718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:12:09 devstack sudo[111718]: pam_unix(sudo:session): session closed for user root Aug 03 09:12:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.237s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:12:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:12:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:12:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:12:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:12:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:12:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:13:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:13:08 devstack sudo[111773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:13:08 devstack sudo[111773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:13:09 devstack sudo[111773]: pam_unix(sudo:session): session closed for user root Aug 03 09:13:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.244s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:13:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:13:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:13:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:13:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:14:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:14:08 devstack sudo[111830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:14:08 devstack sudo[111830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:14:09 devstack sudo[111830]: pam_unix(sudo:session): session closed for user root Aug 03 09:14:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:14:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:14:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:14:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:14:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:14:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:14:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (8eeef2a0-e7e3-447f-a26d-f520dae63540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af74a317-4f23-47b8-94c8-81b9dcc9e157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af74a317-4f23-47b8-94c8-81b9dcc9e157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2027312054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f495e2-3da2-40cc-b2ac-77ac659a11d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caaa9e8a9046029ce30f8430e655a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:02Z,use_quota=True,user_id='a24827caa3e945a988603626b50e1f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0a3a1-fbb2-48d1-9650-41c5f57a467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0a3a1-fbb2-48d1-9650-41c5f57a467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0286991-ecf9-425b-a71d-e5e08a55c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0286991-ecf9-425b-a71d-e5e08a55c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77f495e2-3da2-40cc-b2ac-77ac659a11d2', 'volume_name': 'volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417d384f-c676-4b13-b308-1125cced2673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (417d384f-c676-4b13-b308-1125cced2673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054f3cc4-fc90-4054-ac4f-b2bc25ef0916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:01 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 09:15:01 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Trying to clone 77f495e2-3da2-40cc-b2ac-77ac659a11d2 from image c75f21ad-13ee-4896-b738-8427054e27d1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:15:02 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Image download 20.69 MB at 20.69 MB/s Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a257ac-1278-48b3-8732-6cc77e2a7f5d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:02 devstack sudo[111890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD Aug 03 09:15:02 devstack sudo[111890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:02 devstack sudo[111890]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 is fetched for user a24827caa3e945a988603626b50e1f31. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[29928e71-573b-481b-b602-eeef8c0c5fc4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:02 devstack sudo[111895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD Aug 03 09:15:02 devstack sudo[111895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:03 devstack sudo[111895]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2027312054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f495e2-3da2-40cc-b2ac-77ac659a11d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caaa9e8a9046029ce30f8430e655a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:02Z,use_quota=True,user_id='a24827caa3e945a988603626b50e1f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Creating volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:03 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:03 devstack sudo[111900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1073741824 Aug 03 09:15:03 devstack sudo[111900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:03 devstack sudo[111900]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1073741824" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:03 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:03 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:03 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Attempting download of c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a73bd1-bde9-45cf-a7e8-9a20ae3efd09]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:03 devstack sudo[111909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr Aug 03 09:15:03 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:04 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:04 devstack sudo[111913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr Aug 03 09:15:04 devstack sudo[111913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:04 devstack sudo[111913]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr" returned: 1 in 0.312s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c75f21ad-13ee-4896-b738-8427054e27d1_7mh2mvfr' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9700f872-67f8-4d46-a66f-9024d35b6a7b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:04 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD Aug 03 09:15:04 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:04 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] c75f21ad-13ee-4896-b738-8427054e27d1 was qcow2, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:15:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:04 devstack sudo[111922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:04 devstack sudo[111922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:06 devstack sudo[111922]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 1.539s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c75f21ad-13ee-4896-b738-8427054e27d1_ice0qubzdevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:15:06 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Converted 112.00 MB image at 72.72 MB/s Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:06 devstack sudo[111929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1G Aug 03 09:15:06 devstack sudo[111929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:06 devstack sudo[111929]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 1G" returned: 0 in 0.290s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Downloaded image c75f21ad-13ee-4896-b738-8427054e27d1 ((None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}])) to volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Temporary image c75f21ad-13ee-4896-b738-8427054e27d1 for user a24827caa3e945a988603626b50e1f31 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Marking volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Copying metadata from image c75f21ad-13ee-4896-b738-8427054e27d1 to 77f495e2-3da2-40cc-b2ac-77ac659a11d2. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Creating volume glance metadata for volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 backed by image c75f21ad-13ee-4896-b738-8427054e27d1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054f3cc4-fc90-4054-ac4f-b2bc25ef0916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2', 'volume_size': 1, 'image_id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c75f21ad-13ee-4896-b738-8427054e27d1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '4d8815af3b50402fb762baa1808e05b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c75f21ad-13ee-4896-b738-8427054e27d1', 'created_at': datetime.datetime(2026, 8, 3, 6, 39, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 6, 39, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c75f21ad-13ee-4896-b738-8427054e27d1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c6dc7-ce2a-48f0-8503-49df3303be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:06 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Volume volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 (77f495e2-3da2-40cc-b2ac-77ac659a11d2): created successfully Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25c6dc7-ce2a-48f0-8503-49df3303be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (8eeef2a0-e7e3-447f-a26d-f520dae63540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:06 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9152119d-cb4c-4fc9-bd01-7f32b66fb66b tempest-TestVolumeBootPattern-990222927 None] Created volume successfully. Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Creating offline snapshot 3d3dc254-06f6-4bdc-9276-de406630e7a5 of volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e5cac2-e472-40cd-ae4a-325a35d3914a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:07 devstack sudo[111935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:07 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:07 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:07 devstack sudo[111940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 1G Aug 03 09:15:07 devstack sudo[111940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:07 devstack sudo[111940]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 1G" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:07 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:07 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:08 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:08 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 is being set with open permissions: ugo+rw Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:08 devstack sudo[111951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:08 devstack sudo[111951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:08 devstack sudo[111951]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.229s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:08 devstack sudo[111954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info Aug 03 09:15:08 devstack sudo[111954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:08 devstack sudo[111954]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:08 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info is being set with open permissions: ugo+rw Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:08 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info Aug 03 09:15:08 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:08 devstack sudo[111961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:08 devstack sudo[111961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:08 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.info" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3e92f8d2-e108-4583-9b9f-571239cb7cfc tempest-TestVolumeBootPattern-990222927 None] Create snapshot completed successfully Aug 03 09:15:09 devstack sudo[111961]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:15:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:15:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (23b96569-1be4-4f3d-b1e7-ad40dbb61a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fd5456-6393-4c16-b4da-600d80a09f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fd5456-6393-4c16-b4da-600d80a09f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:12Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3caaa9e8a9046029ce30f8430e655a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d3dc254-06f6-4bdc-9276-de406630e7a5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:12Z,use_quota=True,user_id='a24827caa3e945a988603626b50e1f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0b6d55-6fa5-4190-bd0b-9f4e66b057d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0b6d55-6fa5-4190-bd0b-9f4e66b057d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d2b4f-580f-4ca3-8c5b-b82fbda976fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481d2b4f-580f-4ca3-8c5b-b82fbda976fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34', 'volume_name': 'volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34', 'volume_size': 1, 'snapshot_id': '3d3dc254-06f6-4bdc-9276-de406630e7a5'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44b7ac7-7163-48af-b877-58bbaa818437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a44b7ac7-7163-48af-b877-58bbaa818437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc4aa7-6769-4b59-b354-f4fc7f85bbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Volume ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34', 'volume_size': 1, 'snapshot_id': '3d3dc254-06f6-4bdc-9276-de406630e7a5'} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Creating volume ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 from snapshot 3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] snapshot: 3d3dc254-06f6-4bdc-9276-de406630e7a5, volume: ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc425cfe-cb38-40b4-b85a-67182834199a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:12 devstack sudo[111968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:12 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:12 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.407s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5196d05f-c686-425b-b2b4-f69cb16875ab]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:12 devstack sudo[111973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:12 devstack sudo[111973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:13 devstack sudo[111973]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:15:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:15:13 devstack cinder-volume[88796]: DEBUG cinder.utils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:15:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:13 devstack sudo[111980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 Aug 03 09:15:13 devstack sudo[111980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:14 devstack sudo[111980]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" returned: 0 in 1.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2, size 1024.00 MB, duration 1.24 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:15:14 devstack cinder-volume[88796]: INFO cinder.image.image_utils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Converted 1024.00 MB image at 825.54 MB/s Aug 03 09:15:14 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 is being set with open permissions: ugo+rw Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:14 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 Aug 03 09:15:14 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:14 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" returned: 0 in 0.232s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" released by "_copy_volume_from_snapshot" :: held 2.347s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" released by "_create_volume_from_snapshot" :: held 2.404s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.421s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Marking volume ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Copying metadata from snapshot 3d3dc254-06f6-4bdc-9276-de406630e7a5 to ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc4aa7-6769-4b59-b354-f4fc7f85bbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34', 'volume_size': 1, 'snapshot_id': '3d3dc254-06f6-4bdc-9276-de406630e7a5'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2755899a-0644-4e2c-a5d8-aa57a3cd991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Volume volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 (ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34): created successfully Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2755899a-0644-4e2c-a5d8-aa57a3cd991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Flow 'volume_create_manager' (23b96569-1be4-4f3d-b1e7-ad40dbb61a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-1547d870-353c-4e8d-bef3-c45b2688eb0c tempest-TestVolumeBootPattern-990222927 None] Created volume successfully. Aug 03 09:15:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-5b963818-9e94-4eca-ae88-f6cdb9662732 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-5b963818-9e94-4eca-ae88-f6cdb9662732 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-5b963818-9e94-4eca-ae88-f6cdb9662732 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-5b963818-9e94-4eca-ae88-f6cdb9662732 tempest-TestVolumeBootPattern-990222927 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30653db1-2fb0-415a-ae97-2e874523c18b', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:15:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-6eb7f665-af8b-4fc6-b9aa-26ceffa3a1ca req-5b963818-9e94-4eca-ae88-f6cdb9662732 tempest-TestVolumeBootPattern-990222927 None] attachment_update completed successfully. Aug 03 09:15:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-fb8fc770-c81d-483a-aa40-a0fa4eda1d9f tempest-TestVolumeBootPattern-990222927 None] Terminate volume connection completed successfully. Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-fb8fc770-c81d-483a-aa40-a0fa4eda1d9f tempest-TestVolumeBootPattern-990222927 None] Deleting attachment 30653db1-2fb0-415a-ae97-2e874523c18b. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa8b1eb-7007-49a8-90c9-88e19b64ca8a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:21 devstack sudo[112511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 Aug 03 09:15:21 devstack sudo[112511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:21 devstack sudo[112511]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:21 devstack sudo[112516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34 Aug 03 09:15:21 devstack sudo[112516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:21 devstack sudo[112516]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34" released by "delete_volume" :: held 0.640s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:21 devstack cinder-volume[88796]: DEBUG cinder.quota [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Created reservations ['b714bc8c-80a6-4cfa-ab24-8f17c2484320', '2e7fe905-503c-41f6-8272-f08786830ad3', '90e95807-25c3-416d-b678-4a508c080f04', '3c096dff-4c1d-4c59-8b5a-32aa87a2db5b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:22 devstack sudo[112520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:22 devstack sudo[112520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-3d3dc254-06f6-4bdc-9276-de406630e7a5-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-3d3dc254-06f6-4bdc-9276-de406630e7a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Deleting offline snapshot 3d3dc254-06f6-4bdc-9276-de406630e7a5 of volume 77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] snapshot_file for this snap is: volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c118cb-1ec4-41b4-8185-fcc09677ae02]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:22 devstack sudo[112520]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.manager [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Deleted volume successfully. Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [req-f91508de-a5a6-4de7-80ce-6473b7c238fb req-cfaa67fc-82a4-4d25-a753-47e11184eff0 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-ad89aaf4-bba5-4ccc-840d-5dec5ccc0e34-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:22 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:22 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:22 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[616ee5dc-a4ae-46c4-b00e-c46ded4251e2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:22 devstack sudo[112528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:22 devstack sudo[112528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:23 devstack sudo[112528]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:23 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:23 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:23 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:23 devstack sudo[112539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5 Aug 03 09:15:23 devstack sudo[112539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:23 devstack sudo[112539]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2.3d3dc254-06f6-4bdc-9276-de406630e7a5" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-3d3dc254-06f6-4bdc-9276-de406630e7a5" released by "_delete_snapshot" :: held 1.383s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" released by "delete_snapshot" :: held 1.407s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Created reservations ['09fba1d5-7f0a-4ab8-9868-1d12b819b830', '2c077bcb-e169-4a19-92c1-165e182626f3', '4402aa72-8584-4918-8421-b47df1190d27', '5bd4793c-d77e-43ef-a756-6268e40cf846'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Delete snapshot completed successfully. Aug 03 09:15:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d355bb70-d17b-464a-9219-735990ed0106 tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-3d3dc254-06f6-4bdc-9276-de406630e7a5-delete_snapshot" released by "delete_snapshot" :: held 1.549s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-77f495e2-3da2-40cc-b2ac-77ac659a11d2-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-77f495e2-3da2-40cc-b2ac-77ac659a11d2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[85938920-f77f-4e37-a2e6-ce0f046b8ade]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:24 devstack sudo[112542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:24 devstack sudo[112542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:24 devstack sudo[112542]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:24 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2 Aug 03 09:15:24 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:25 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-77f495e2-3da2-40cc-b2ac-77ac659a11d2" returned: 0 in 0.231s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-quobyte-77f495e2-3da2-40cc-b2ac-77ac659a11d2" released by "delete_volume" :: held 0.642s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Created reservations ['ae31e4e3-900d-4344-b328-7764fc40e909', '2047cdeb-6df0-4dd7-8ffd-1950da83aa9c', '1ae843bb-faa4-4807-b197-36fb91d5a5d0', '82ee89ae-31f7-4c2b-b236-ca0efff535ab'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:25 devstack sudo[112550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:25 devstack sudo[112550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:25 devstack sudo[112550]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Deleted volume successfully. Aug 03 09:15:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26c70989-35d2-4391-a45b-f5ac567eb7db tempest-TestVolumeBootPattern-990222927 None] Lock "cinder-77f495e2-3da2-40cc-b2ac-77ac659a11d2-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=40,cinder:INSERT=24,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:15:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=33,cinder:SELECT=45,cinder:INSERT=30,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (c7868a56-d416-4351-8f4b-91127486c6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10024fb2-f054-4c7e-81f3-926771c14f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10024fb2-f054-4c7e-81f3-926771c14f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803510296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aed43db-c42d-430b-83e5-5e13ffbe4719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:45Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e03d0b-0205-4b1b-84e6-f0f41f2e5baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e03d0b-0205-4b1b-84e6-f0f41f2e5baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0847a33-cd3c-4a45-a2eb-e1ef2c10f41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0847a33-cd3c-4a45-a2eb-e1ef2c10f41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aed43db-c42d-430b-83e5-5e13ffbe4719', 'volume_name': 'volume-9aed43db-c42d-430b-83e5-5e13ffbe4719', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6401704-d8f4-4a51-b55d-9c198c750b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6401704-d8f4-4a51-b55d-9c198c750b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f60961-4151-4a7c-9fee-92dd6e76b4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Volume 9aed43db-c42d-430b-83e5-5e13ffbe4719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aed43db-c42d-430b-83e5-5e13ffbe4719', 'volume_size': 1} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803510296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aed43db-c42d-430b-83e5-5e13ffbe4719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:45Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Creating volume 9aed43db-c42d-430b-83e5-5e13ffbe4719 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:45 devstack sudo[112631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 1073741824 Aug 03 09:15:45 devstack sudo[112631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (d040b24a-a832-4edc-9d2c-7d2da23c0971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0dd9db-f699-43a2-b2d4-5a231e1ccc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d0dd9db-f699-43a2-b2d4-5a231e1ccc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980746920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b061a548-804d-475f-a1ee-5914028413f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:46Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ee906b-a1bb-4ce0-a78a-f7af3e86842c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46ee906b-a1bb-4ce0-a78a-f7af3e86842c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c093081-8fef-46d8-b80a-58e65c543541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c093081-8fef-46d8-b80a-58e65c543541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b061a548-804d-475f-a1ee-5914028413f0', 'volume_name': 'volume-b061a548-804d-475f-a1ee-5914028413f0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24889541-bed4-4fdb-beee-3666b6459167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24889541-bed4-4fdb-beee-3666b6459167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab05f10-61fa-49e3-b85d-d57f04631738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Volume b061a548-804d-475f-a1ee-5914028413f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b061a548-804d-475f-a1ee-5914028413f0', 'volume_size': 1} Aug 03 09:15:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:46 devstack sudo[112631]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 1073741824" returned: 0 in 0.932s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:46 devstack sudo[112639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 Aug 03 09:15:46 devstack sudo[112639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (8b1b33ba-387a-4529-bac5-abad4ba95357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e38a530-ce59-4f3c-b90f-24282d5de902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e38a530-ce59-4f3c-b90f-24282d5de902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945221007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc662f-fc3b-4146-b284-a02fbbeb21fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:46Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762cabc8-7930-4a56-a115-e00c0d7cbd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762cabc8-7930-4a56-a115-e00c0d7cbd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37abdaa6-39f2-4c05-8746-67aca57af5db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37abdaa6-39f2-4c05-8746-67aca57af5db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46cc662f-fc3b-4146-b284-a02fbbeb21fe', 'volume_name': 'volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a2b79a-6e78-4874-b43f-b48848629193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3a2b79a-6e78-4874-b43f-b48848629193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747d86cf-db28-46e8-8e62-f77c55610212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Volume 46cc662f-fc3b-4146-b284-a02fbbeb21fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe', 'volume_size': 1} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:46 devstack sudo[112639]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719" returned: 0 in 0.403s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.697s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-980746920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b061a548-804d-475f-a1ee-5914028413f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:46Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Creating volume b061a548-804d-475f-a1ee-5914028413f0 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:46 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f60961-4151-4a7c-9fee-92dd6e76b4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aed43db-c42d-430b-83e5-5e13ffbe4719', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack sudo[112642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 1073741824 Aug 03 09:15:46 devstack sudo[112642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644b2208-670c-4260-8357-d9d9452efa52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Volume volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 (9aed43db-c42d-430b-83e5-5e13ffbe4719): created successfully Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644b2208-670c-4260-8357-d9d9452efa52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (c7868a56-d416-4351-8f4b-91127486c6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ebf47e98-e5ef-4b23-b1ab-c62541cdb35a tempest-CreateVolumesFromImageTest-708804581 None] Created volume successfully. Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (7710cb17-0baa-4422-916f-54fa0d695456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bf4fc7-c28c-4340-8858-bc5a06f5871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bf4fc7-c28c-4340-8858-bc5a06f5871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328841600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93748365-38e8-4d04-84b5-b3fbed3b77a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:47Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7970d0-1220-405a-9dd0-9957813395de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7970d0-1220-405a-9dd0-9957813395de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7feca6a0-2857-4883-8d6b-ea16f6c4a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7feca6a0-2857-4883-8d6b-ea16f6c4a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93748365-38e8-4d04-84b5-b3fbed3b77a0', 'volume_name': 'volume-93748365-38e8-4d04-84b5-b3fbed3b77a0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497bb434-bd3b-4b9f-b409-ef2e847390ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497bb434-bd3b-4b9f-b409-ef2e847390ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e178e4-d101-441c-a4ff-cdea33bc67fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Volume 93748365-38e8-4d04-84b5-b3fbed3b77a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93748365-38e8-4d04-84b5-b3fbed3b77a0', 'volume_size': 1} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (74267e80-50a0-4a4d-a7ec-3b65f94f7840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d49e916-f3d0-4cb2-b9a5-1886d440ad0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d49e916-f3d0-4cb2-b9a5-1886d440ad0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210713169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb545e32-376e-4e90-a2b4-a22f634295bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:47Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d2404c-1d92-4f69-aa47-d3eaea4bf64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19d2404c-1d92-4f69-aa47-d3eaea4bf64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab74946-c253-47c9-a4c8-91960b6e35e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab74946-c253-47c9-a4c8-91960b6e35e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb545e32-376e-4e90-a2b4-a22f634295bb', 'volume_name': 'volume-bb545e32-376e-4e90-a2b4-a22f634295bb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97db7501-a672-42ff-9260-e22e2655d168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97db7501-a672-42ff-9260-e22e2655d168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86220b4e-9444-4d38-9ffe-5a5304260270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Volume bb545e32-376e-4e90-a2b4-a22f634295bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb545e32-376e-4e90-a2b4-a22f634295bb', 'volume_size': 1} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:47 devstack sudo[112642]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 1073741824" returned: 0 in 0.849s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:47 devstack sudo[112648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 Aug 03 09:15:47 devstack sudo[112648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:47 devstack sudo[112648]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945221007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46cc662f-fc3b-4146-b284-a02fbbeb21fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:46Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Creating volume 46cc662f-fc3b-4146-b284-a02fbbeb21fe {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:47 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab05f10-61fa-49e3-b85d-d57f04631738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b061a548-804d-475f-a1ee-5914028413f0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50bee32-9481-4993-a062-190395f3398b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:47 devstack sudo[112651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe 1073741824 Aug 03 09:15:47 devstack sudo[112651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Volume volume-b061a548-804d-475f-a1ee-5914028413f0 (b061a548-804d-475f-a1ee-5914028413f0): created successfully Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50bee32-9481-4993-a062-190395f3398b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (d040b24a-a832-4edc-9d2c-7d2da23c0971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-58815923-0409-4e16-8c46-f5950ce5151f tempest-CreateVolumesFromImageTest-708804581 None] Created volume successfully. Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe 1073741824" returned: 0 in 0.523s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:48 devstack sudo[112651]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:48 devstack sudo[112657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe Aug 03 09:15:48 devstack sudo[112657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:48 devstack sudo[112657]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1328841600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93748365-38e8-4d04-84b5-b3fbed3b77a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:47Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Creating volume 93748365-38e8-4d04-84b5-b3fbed3b77a0 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:48 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:48 devstack sudo[112661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 1073741824 Aug 03 09:15:48 devstack sudo[112661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747d86cf-db28-46e8-8e62-f77c55610212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ccd794-4cc7-4c01-bac1-b93732c6dd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Volume volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe (46cc662f-fc3b-4146-b284-a02fbbeb21fe): created successfully Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ccd794-4cc7-4c01-bac1-b93732c6dd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (8b1b33ba-387a-4529-bac5-abad4ba95357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5c648a73-683a-453c-96d5-8724a9d171d8 tempest-CreateVolumesFromImageTest-708804581 None] Created volume successfully. Aug 03 09:15:49 devstack sudo[112661]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 1073741824" returned: 0 in 0.535s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:49 devstack sudo[112667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 Aug 03 09:15:49 devstack sudo[112667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:49 devstack sudo[112667]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0" returned: 0 in 0.362s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.233s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-210713169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb545e32-376e-4e90-a2b4-a22f634295bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd76f9954db54e659be35a779bba2c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:47Z,use_quota=True,user_id='2969f78319f34aadb67e813f66fe150c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Creating volume bb545e32-376e-4e90-a2b4-a22f634295bb {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:49 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:49 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb 1073741824 Aug 03 09:15:49 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e178e4-d101-441c-a4ff-cdea33bc67fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93748365-38e8-4d04-84b5-b3fbed3b77a0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c8983f-d8c4-446d-90d0-65a6ea185214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Volume volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 (93748365-38e8-4d04-84b5-b3fbed3b77a0): created successfully Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9c8983f-d8c4-446d-90d0-65a6ea185214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (7710cb17-0baa-4422-916f-54fa0d695456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (40429df5-65d8-4ca0-8ff4-14d5221baa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4b8dbc-bd5d-435f-90ad-40e133c7d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4c116cef-5759-4556-a5f1-b803f70d17c6 tempest-CreateVolumesFromImageTest-708804581 None] Created volume successfully. Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f4b8dbc-bd5d-435f-90ad-40e133c7d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2296c96-8b4e-422b-bfa3-6356e033943b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:50Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbe0488-81d3-4cfd-8b12-be953e710baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bbe0488-81d3-4cfd-8b12-be953e710baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b253395a-8bab-4905-a3da-3516b570a396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:15:50 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb 1073741824" returned: 0 in 0.572s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:50 devstack sudo[112676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb Aug 03 09:15:50 devstack sudo[112676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b253395a-8bab-4905-a3da-3516b570a396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2296c96-8b4e-422b-bfa3-6356e033943b', 'volume_name': 'volume-e2296c96-8b4e-422b-bfa3-6356e033943b', 'volume_size': 1, 'image_id': '058d72b4-0bdf-4400-a934-153973e43f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f835e2e92e2343f4937f4dd9fd10620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1be953df27b772f8e0c2ee731b572f730ee4d34758b0c5a7bae2e0151fe15a7e5be12eb38a5fc2ffbe782d7a29bc9ebd876ee7b4fe43d2b1e9516539a831c5fb', 'id': '058d72b4-0bdf-4400-a934-153973e43f87', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/058d72b4-0bdf-4400-a934-153973e43f87/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce61d582-5614-4486-b730-a5d77335a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce61d582-5614-4486-b730-a5d77335a11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9db2d6-bfb9-4f84-88c8-0ff6f27b4d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Volume e2296c96-8b4e-422b-bfa3-6356e033943b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2296c96-8b4e-422b-bfa3-6356e033943b', 'volume_size': 1, 'image_id': '058d72b4-0bdf-4400-a934-153973e43f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f835e2e92e2343f4937f4dd9fd10620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1be953df27b772f8e0c2ee731b572f730ee4d34758b0c5a7bae2e0151fe15a7e5be12eb38a5fc2ffbe782d7a29bc9ebd876ee7b4fe43d2b1e9516539a831c5fb', 'id': '058d72b4-0bdf-4400-a934-153973e43f87', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/058d72b4-0bdf-4400-a934-153973e43f87/file', 'properties': {}}, 'image_service': } Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Trying to clone e2296c96-8b4e-422b-bfa3-6356e033943b from image 058d72b4-0bdf-4400-a934-153973e43f87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:15:50 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce55bff6-b2be-43bb-b989-98f89172a5ec]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:50 devstack sudo[112676]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86220b4e-9444-4d38-9ffe-5a5304260270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb545e32-376e-4e90-a2b4-a22f634295bb', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bb9253-dffe-4f73-b56e-26183721d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Volume volume-bb545e32-376e-4e90-a2b4-a22f634295bb (bb545e32-376e-4e90-a2b4-a22f634295bb): created successfully Aug 03 09:15:50 devstack sudo[112679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:50 devstack sudo[112679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bb9253-dffe-4f73-b56e-26183721d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Flow 'volume_create_manager' (74267e80-50a0-4a4d-a7ec-3b65f94f7840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-45b7b1bd-f063-414c-8c23-b78df15d8888 tempest-CreateVolumesFromImageTest-708804581 None] Created volume successfully. Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Flow 'volume_create_manager' (4b5d2a7b-4d9b-4ac4-b18f-1053e1945cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:51 devstack sudo[112679]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aed97e-2bd9-4f21-86e3-ecec1dea3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-bb545e32-376e-4e90-a2b4-a22f634295bb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31aed97e-2bd9-4f21-86e3-ecec1dea3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acd5628-ab07-4d6e-ae8a-58cdd38bcaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8771d220cdb94fe0b5b5562c4ab9743b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:51Z,use_quota=True,user_id='63beb304bb924e2ab26a8a7fb57cafaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8422a2b0-13aa-4864-8cad-20132423b515),volume_type_id=8422a2b0-13aa-4864-8cad-20132423b515)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c61ff-050a-4bb8-bf7a-1d30229d88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179c61ff-050a-4bb8-bf7a-1d30229d88d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752b2ec0-e63d-4980-9da3-354de1521224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-bb545e32-376e-4e90-a2b4-a22f634295bb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-quobyte-bb545e32-376e-4e90-a2b4-a22f634295bb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-bb545e32-376e-4e90-a2b4-a22f634295bb" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:51 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:51 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[595ed120-b0bb-4d0e-bd03-70fac7534b28]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:51 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb Aug 03 09:15:51 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:51 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 1 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Temporary image 058d72b4-0bdf-4400-a934-153973e43f87 is fetched for user f707fbd9908744f7b51191626725df12. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faa1087-96d1-4ea9-83a0-39f8d8bbd590]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752b2ec0-e63d-4980-9da3-354de1521224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0acd5628-ab07-4d6e-ae8a-58cdd38bcaef', 'volume_name': 'volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef', 'volume_size': 1, 'image_id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84c6cef262869b272519983b2d194848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8771d220cdb94fe0b5b5562c4ab9743b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16449f42e3c08a07c12dbcb55c902d0630afa7737b65d092b39f64c6b125f4f14f5a4184ca49ebbd5516d4783c1dfdf499ccbc2deacefe4bea4b6e25cabbfba9', 'id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5546ed7-e85d-428f-97f7-210d8812a653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5546ed7-e85d-428f-97f7-210d8812a653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae464a1-bdcd-4da7-8bb6-f1b735a5d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef', 'volume_size': 1, 'image_id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84c6cef262869b272519983b2d194848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8771d220cdb94fe0b5b5562c4ab9743b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16449f42e3c08a07c12dbcb55c902d0630afa7737b65d092b39f64c6b125f4f14f5a4184ca49ebbd5516d4783c1dfdf499ccbc2deacefe4bea4b6e25cabbfba9', 'id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Trying to clone 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef from image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:15:51 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb" returned: 0 in 0.490s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:15:51 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:15:51 devstack sudo[112691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:51 devstack sudo[112691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:51 devstack sudo[112694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb Aug 03 09:15:51 devstack sudo[112694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb610f-3ca0-4f00-b37c-07e6b76795df]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:52 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:52 devstack sudo[112694]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack sudo[112691]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-bb545e32-376e-4e90-a2b4-a22f634295bb" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-bb545e32-376e-4e90-a2b4-a22f634295bb" released by "delete_volume" :: held 0.856s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Created reservations ['b34c871d-fcdd-47e4-a808-f3fe90d8ab02', '773e7deb-b03e-40a1-bb6e-16eae46628cd', 'ab9497f9-d1bc-476a-a3ee-21d0c4214d2e', 'f228acc6-2f08-4756-9e1e-cc7a8009b3d8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:52 devstack sudo[112702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:52 devstack sudo[112702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:52 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack sudo[112707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:52 devstack sudo[112707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:52 devstack sudo[112706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:52 devstack sudo[112706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:52 devstack sudo[112702]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2296c96-8b4e-422b-bfa3-6356e033943b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:50Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Creating volume e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:52 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack sudo[112716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1073741824 Aug 03 09:15:52 devstack sudo[112716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:52 devstack sudo[112707]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:52 devstack sudo[112706]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 1 in 0.362s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Temporary image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 is fetched for user 63beb304bb924e2ab26a8a7fb57cafaf. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:15:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Deleted volume successfully. Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a6667a0d-e76c-4036-b61b-251f627bdf22 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-bb545e32-376e-4e90-a2b4-a22f634295bb-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf5a2b3-0da8-4b99-aef9-ba967c92761f]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:52 devstack sudo[112725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:52 devstack sudo[112725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack sudo[112716]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1073741824" returned: 0 in 0.600s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack sudo[112725]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack sudo[112733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b Aug 03 09:15:53 devstack sudo[112733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (b7e49b99-95b4-4878-9ad7-83935b8fe33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2717a5f6-4b12-4b06-8c89-eb49a5c45d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:53 devstack sudo[112735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2717a5f6-4b12-4b06-8c89-eb49a5c45d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799845800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89785b9-9008-4e96-bfe9-a5837a9805ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:53Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:53 devstack sudo[112735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b0d791-32cc-4019-bfab-509ef53be259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b0d791-32cc-4019-bfab-509ef53be259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd9b32-9f07-4f1f-8db2-6b1b3041ddbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0dd9b32-9f07-4f1f-8db2-6b1b3041ddbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c89785b9-9008-4e96-bfe9-a5837a9805ca', 'volume_name': 'volume-c89785b9-9008-4e96-bfe9-a5837a9805ca', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a77310-03db-4c23-844b-45b825b73898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a77310-03db-4c23-844b-45b825b73898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a31430-1e87-4f5d-85ec-c61afefa4225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:53 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Volume c89785b9-9008-4e96-bfe9-a5837a9805ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c89785b9-9008-4e96-bfe9-a5837a9805ca', 'volume_size': 1} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-93748365-38e8-4d04-84b5-b3fbed3b77a0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-93748365-38e8-4d04-84b5-b3fbed3b77a0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-quobyte-93748365-38e8-4d04-84b5-b3fbed3b77a0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:53 devstack sudo[112733]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.086s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799845800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c89785b9-9008-4e96-bfe9-a5837a9805ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:53Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Creating volume c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:53 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-93748365-38e8-4d04-84b5-b3fbed3b77a0" acquired by "delete_volume" :: waited 0.056s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:53 devstack sudo[112738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca 1073741824 Aug 03 09:15:53 devstack sudo[112738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Attempting download of 058d72b4-0bdf-4400-a934-153973e43f87 ((None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}])) to volume e2296c96-8b4e-422b-bfa3-6356e033943b. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd541d60-76b8-4586-a876-f106663fb995]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7cee32-40f4-4ae0-8945-47bfc9dfe389]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack sudo[112735]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 1 in 0.464s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:53 devstack sudo[112740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 Aug 03 09:15:53 devstack sudo[112740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack sudo[112741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20 Aug 03 09:15:53 devstack sudo[112741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:53 devstack sudo[112741]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack sudo[112740]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack sudo[112738]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca 1073741824" returned: 0 in 0.519s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack sudo[112756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0 Aug 03 09:15:54 devstack sudo[112756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack sudo[112758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca Aug 03 09:15:54 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20 Aug 03 09:15:54 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack sudo[112756]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-93748365-38e8-4d04-84b5-b3fbed3b77a0" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-93748365-38e8-4d04-84b5-b3fbed3b77a0" released by "delete_volume" :: held 0.765s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:54 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20" returned: 1 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_058d72b4-0bdf-4400-a934-153973e43f87_l6ilor20' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f406777e-d04c-4b37-80d2-6e2080ee55b3]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:54 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0acd5628-ab07-4d6e-ae8a-58cdd38bcaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8771d220cdb94fe0b5b5562c4ab9743b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:15:51Z,use_quota=True,user_id='63beb304bb924e2ab26a8a7fb57cafaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8422a2b0-13aa-4864-8cad-20132423b515),volume_type_id=8422a2b0-13aa-4864-8cad-20132423b515)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Creating volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:15:54 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Created reservations ['01f147b2-f5e4-4e81-9f0f-01d213550c11', '5b1a88d1-9665-4503-b8c4-2bb848c54707', '0016d4df-6c8c-4abd-8f43-500227e015f1', 'ca369a02-a86c-426c-b864-d226e723c162'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a31430-1e87-4f5d-85ec-c61afefa4225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c89785b9-9008-4e96-bfe9-a5837a9805ca', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:54 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1073741824 Aug 03 09:15:54 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a7dc0c-253a-4481-bc31-e4f4891ef007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Volume volume-c89785b9-9008-4e96-bfe9-a5837a9805ca (c89785b9-9008-4e96-bfe9-a5837a9805ca): created successfully Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a7dc0c-253a-4481-bc31-e4f4891ef007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (b7e49b99-95b4-4878-9ad7-83935b8fe33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e4d8b4f0-ec65-4c5f-bba7-0c229a7dd443 tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:15:54 devstack sudo[112765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:54 devstack sudo[112765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:54 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-46cc662f-fc3b-4146-b284-a02fbbeb21fe-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-46cc662f-fc3b-4146-b284-a02fbbeb21fe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-quobyte-46cc662f-fc3b-4146-b284-a02fbbeb21fe" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:54 devstack sudo[112765]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-46cc662f-fc3b-4146-b284-a02fbbeb21fe" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367bf26-f3ee-40f3-bf4a-7b8cec4f0e75]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Deleted volume successfully. Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3127a9b6-5b49-4f1b-bf33-ee2fee546457 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-93748365-38e8-4d04-84b5-b3fbed3b77a0-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:54 devstack sudo[112776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD Aug 03 09:15:54 devstack sudo[112776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe Aug 03 09:15:54 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:54 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1073741824" returned: 0 in 0.558s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:54 devstack sudo[112784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef Aug 03 09:15:54 devstack sudo[112784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack sudo[112776]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD" returned: 1 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] 058d72b4-0bdf-4400-a934-153973e43f87 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack sudo[112794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b Aug 03 09:15:55 devstack sudo[112794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack sudo[112796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe Aug 03 09:15:55 devstack sudo[112796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack sudo[112784]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Attempting download of ece029a5-aaaa-4e31-880a-0cd1136ee1b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}])) to volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d53b03-971b-4cfc-ba4a-a29b84731cfe]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack sudo[112796]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-46cc662f-fc3b-4146-b284-a02fbbeb21fe" returned: 0 in 0.299s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u Aug 03 09:15:55 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-46cc662f-fc3b-4146-b284-a02fbbeb21fe" released by "delete_volume" :: held 0.756s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Created reservations ['f20aa06d-0522-4b36-8eca-9d0b478b3dec', '1c95acb9-bc6b-4937-a124-c4f708404a7e', 'ab3c63b7-2e1a-4a20-86cd-263e208279c5', 'd553e359-2c5c-4278-a1b2-556cd0aca82c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 6167cae1-df68-4d3f-93da-9c813a58db59 of volume c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e54d6d-0d58-498b-8dd1-67384535f017]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack sudo[112807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:55 devstack sudo[112807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack sudo[112794]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b" returned: 0 in 0.619s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca Aug 03 09:15:55 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_058d72b4-0bdf-4400-a934-153973e43f87_8gcg2_8kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:15:55 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:15:55 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u" returned: 0 in 0.452s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:55 devstack sudo[112812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1G Aug 03 09:15:55 devstack sudo[112812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-b061a548-804d-475f-a1ee-5914028413f0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-b061a548-804d-475f-a1ee-5914028413f0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:55 devstack sudo[112813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u Aug 03 09:15:55 devstack sudo[112813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-quobyte-b061a548-804d-475f-a1ee-5914028413f0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-b061a548-804d-475f-a1ee-5914028413f0" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b10f44-d5d4-4b72-be0c-8c0440d50940]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112807]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Deleted volume successfully. Aug 03 09:15:56 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 Aug 03 09:15:56 devstack sudo[112816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack sudo[112822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 1G Aug 03 09:15:56 devstack sudo[112822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5c64c075-9743-489f-b2fb-38e5f35c7d83 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-46cc662f-fc3b-4146-b284-a02fbbeb21fe-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:56 devstack sudo[112813]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u" returned: 1 in 0.426s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_sm54tn6u' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c16d7-c6e5-44a0-8830-3480bf75fe4c]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112812]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b 1G" returned: 0 in 0.566s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Downloaded image 058d72b4-0bdf-4400-a934-153973e43f87 ((None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}])) to volume e2296c96-8b4e-422b-bfa3-6356e033943b successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Temporary image 058d72b4-0bdf-4400-a934-153973e43f87 for user f707fbd9908744f7b51191626725df12 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Marking volume e2296c96-8b4e-422b-bfa3-6356e033943b as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:15:56 devstack sudo[112829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:56 devstack sudo[112829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Copying metadata from image 058d72b4-0bdf-4400-a934-153973e43f87 to e2296c96-8b4e-422b-bfa3-6356e033943b. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Creating volume glance metadata for volume e2296c96-8b4e-422b-bfa3-6356e033943b backed by image 058d72b4-0bdf-4400-a934-153973e43f87 with: {'image_id': '058d72b4-0bdf-4400-a934-153973e43f87', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4f835e2e92e2343f4937f4dd9fd10620', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa9db2d6-bfb9-4f84-88c8-0ff6f27b4d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2296c96-8b4e-422b-bfa3-6356e033943b', 'volume_size': 1, 'image_id': '058d72b4-0bdf-4400-a934-153973e43f87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/058d72b4-0bdf-4400-a934-153973e43f87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f835e2e92e2343f4937f4dd9fd10620', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1be953df27b772f8e0c2ee731b572f730ee4d34758b0c5a7bae2e0151fe15a7e5be12eb38a5fc2ffbe782d7a29bc9ebd876ee7b4fe43d2b1e9516539a831c5fb', 'id': '058d72b4-0bdf-4400-a934-153973e43f87', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/058d72b4-0bdf-4400-a934-153973e43f87/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea9aa0-7d51-4c4e-9e83-912c2bbce116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:56 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Volume volume-e2296c96-8b4e-422b-bfa3-6356e033943b (e2296c96-8b4e-422b-bfa3-6356e033943b): created successfully Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea9aa0-7d51-4c4e-9e83-912c2bbce116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (40429df5-65d8-4ca0-8ff4-14d5221baa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-80945075-27dc-402c-8018-8a4df3b34deb tempest-VolumeImageDependencyTests-1527199520 None] Created volume successfully. Aug 03 09:15:56 devstack sudo[112816]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0" returned: 0 in 0.518s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0 Aug 03 09:15:56 devstack sudo[112837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack sudo[112829]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112822]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 1G" returned: 0 in 0.523s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89785b9-9008-4e96-bfe9-a5837a9805ca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89785b9-9008-4e96-bfe9-a5837a9805ca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 Aug 03 09:15:56 devstack sudo[112842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack sudo[112841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD Aug 03 09:15:56 devstack sudo[112841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:56 devstack sudo[112837]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b061a548-804d-475f-a1ee-5914028413f0" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-b061a548-804d-475f-a1ee-5914028413f0" released by "delete_volume" :: held 0.854s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Created reservations ['d1f7fcf3-7c6b-43a5-b2f7-06f30c68ca4a', 'd7ae0c6e-439c-4fcc-a772-f23da9b95d9d', 'a47c79d6-863f-4cbd-9995-4d7860ca181e', '8def2566-e197-4676-9fe9-a9333262f3c9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:56 devstack sudo[112852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:56 devstack sudo[112852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112841]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] ece029a5-aaaa-4e31-880a-0cd1136ee1b2 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:15:57 devstack sudo[112842]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c89785b9-9008-4e96-bfe9-a5837a9805ca -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59" returned: 0 in 0.379s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 is being set with open permissions: ugo+rw Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef Aug 03 09:15:57 devstack sudo[112855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 Aug 03 09:15:57 devstack sudo[112856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-9aed43db-c42d-430b-83e5-5e13ffbe4719-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-9aed43db-c42d-430b-83e5-5e13ffbe4719-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:57 devstack sudo[112852]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "cinder-quobyte-9aed43db-c42d-430b-83e5-5e13ffbe4719" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Deleted volume successfully. Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-9aed43db-c42d-430b-83e5-5e13ffbe4719" acquired by "delete_volume" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-94efd540-d9f2-4858-b8dd-7fb10d500741 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-b061a548-804d-475f-a1ee-5914028413f0-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec69f725-1614-49a5-a759-c4908db4f906]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112856]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59" returned: 0 in 0.359s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-e2296c96-8b4e-422b-bfa3-6356e033943b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:57 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 Aug 03 09:15:57 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-e2296c96-8b4e-422b-bfa3-6356e033943b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:57 devstack sudo[112865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-e2296c96-8b4e-422b-bfa3-6356e033943b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-e2296c96-8b4e-422b-bfa3-6356e033943b" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a00d936-a6c2-45d0-9bbd-e71befa5dbb7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b Aug 03 09:15:57 devstack sudo[112869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112855]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" returned: 0 in 0.695s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ece029a5-aaaa-4e31-880a-0cd1136ee1b2_9mzwm8k4devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:15:57 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1G Aug 03 09:15:57 devstack sudo[112874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112865]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info is being set with open permissions: ugo+rw Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719" returned: 0 in 0.467s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:57 devstack sudo[112877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info Aug 03 09:15:57 devstack sudo[112877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719 Aug 03 09:15:57 devstack sudo[112878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:57 devstack sudo[112869]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:58 devstack sudo[112886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b Aug 03 09:15:58 devstack sudo[112886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:58 devstack sudo[112877]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.info" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.511s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:58 devstack sudo[112878]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9aed43db-c42d-430b-83e5-5e13ffbe4719" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-quobyte-9aed43db-c42d-430b-83e5-5e13ffbe4719" released by "delete_volume" :: held 0.833s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2643811d-461d-4817-aba9-08337823724a tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:15:58 devstack sudo[112874]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef 1G" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Downloaded image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}])) to volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Temporary image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 for user 63beb304bb924e2ab26a8a7fb57cafaf is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Marking volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Copying metadata from image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 to 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Creating volume glance metadata for volume 0acd5628-ab07-4d6e-ae8a-58cdd38bcaef backed by image ece029a5-aaaa-4e31-880a-0cd1136ee1b2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '84c6cef262869b272519983b2d194848', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Created reservations ['faf23bad-9b9e-4400-9bb1-7213f2b2bdbf', '76020ac0-c5e1-4a37-9a6c-752c8b05952c', '86ee2903-dac4-46f1-a2e8-d638f4145269', 'eff52401-d774-43aa-b4d8-1270b1cf5b91'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae464a1-bdcd-4da7-8bb6-f1b735a5d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef', 'volume_size': 1, 'image_id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84c6cef262869b272519983b2d194848', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8771d220cdb94fe0b5b5562c4ab9743b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16449f42e3c08a07c12dbcb55c902d0630afa7737b65d092b39f64c6b125f4f14f5a4184ca49ebbd5516d4783c1dfdf499ccbc2deacefe4bea4b6e25cabbfba9', 'id': 'ece029a5-aaaa-4e31-880a-0cd1136ee1b2', 'created_at': datetime.datetime(2026, 8, 3, 7, 15, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 15, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ece029a5-aaaa-4e31-880a-0cd1136ee1b2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:58 devstack sudo[112886]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a3f60-c18f-4ef3-98ee-12baba7d3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e2296c96-8b4e-422b-bfa3-6356e033943b" returned: 0 in 0.293s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Volume volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef (0acd5628-ab07-4d6e-ae8a-58cdd38bcaef): created successfully Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782a3f60-c18f-4ef3-98ee-12baba7d3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Flow 'volume_create_manager' (4b5d2a7b-4d9b-4ac4-b18f-1053e1945cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-e2296c96-8b4e-422b-bfa3-6356e033943b" released by "delete_volume" :: held 0.773s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-950ce945-aa6c-439a-a159-e9f4edaca444 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Created volume successfully. Aug 03 09:15:58 devstack sudo[112893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:58 devstack sudo[112893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['4de56e95-fbf5-4036-b796-0aaa40ce3d46', '601d2f57-1b7f-40a1-841a-ba5c51ed32ca', '68f7fec4-57c3-47a6-bcb9-3212080566ec', '72e9c278-13b5-4932-9451-f15eebbdc072'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Acquiring lock "cinder-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "cinder-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:58 devstack sudo[112895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:58 devstack sudo[112895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Acquiring lock "cinder-quobyte-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "cinder-quobyte-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:58 devstack sudo[112893]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7785b0-67a9-4cd1-aa8f-231fb5d6e016]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Deleted volume successfully. Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c62153ab-edde-4d53-b5c5-018738339cc0 tempest-CreateVolumesFromImageTest-708804581 None] Lock "cinder-9aed43db-c42d-430b-83e5-5e13ffbe4719-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:58 devstack sudo[112899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef Aug 03 09:15:58 devstack sudo[112899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:58 devstack sudo[112895]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.381s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:15:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Deleted volume successfully. Aug 03 09:15:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-29b5e579-77be-4cb0-9a66-ed278fbd389a tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-e2296c96-8b4e-422b-bfa3-6356e033943b-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-6167cae1-df68-4d3f-93da-9c813a58db59-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-6167cae1-df68-4d3f-93da-9c813a58db59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-6167cae1-df68-4d3f-93da-9c813a58db59" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:15:59 devstack sudo[112899]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" returned: 0 in 0.504s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-6167cae1-df68-4d3f-93da-9c813a58db59" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Deleting offline snapshot 6167cae1-df68-4d3f-93da-9c813a58db59 of volume c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:15:59 devstack sudo[112905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef Aug 03 09:15:59 devstack sudo[112905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] snapshot_file for this snap is: volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7842c64b-0054-46c6-9c36-6472a98ef5a3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:59 devstack sudo[112907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 Aug 03 09:15:59 devstack sudo[112907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:59 devstack sudo[112905]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "cinder-quobyte-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef" released by "delete_volume" :: held 0.956s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Created reservations ['6023e0a6-b8f8-4a61-8dc7-54d538148faa', 'bcbf2f21-4e08-4b10-98da-26f30f308fd9', 'b70a8b68-02cf-4235-89ae-bdaf70e3f08c', 'c3ef20a6-07a3-4e7e-9d43-0005c19e5955'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:15:59 devstack sudo[112907]: pam_unix(sudo:session): session closed for user root Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59" returned: 0 in 0.490s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c89785b9-9008-4e96-bfe9-a5837a9805ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9dbe32-d050-4276-b94a-a5b95f59ff29]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:15:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:15:59 devstack sudo[112913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:15:59 devstack sudo[112913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:15:59 devstack sudo[112914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca Aug 03 09:15:59 devstack sudo[112914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:00 devstack sudo[112913]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Deleted volume successfully. Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2e5e80cf-b418-40e3-998b-d56ffac4a692 tempest-VolumeAndVolumeTypeFromImageTest-689128434 None] Lock "cinder-0acd5628-ab07-4d6e-ae8a-58cdd38bcaef-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:00 devstack sudo[112914]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca" returned: 0 in 0.495s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:00 devstack sudo[112921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 Aug 03 09:16:00 devstack sudo[112921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:00 devstack sudo[112921]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59" returned: 0 in 0.435s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:00 devstack sudo[112928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59 Aug 03 09:16:00 devstack sudo[112928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:01 devstack sudo[112928]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca.6167cae1-df68-4d3f-93da-9c813a58db59" returned: 0 in 0.297s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-6167cae1-df68-4d3f-93da-9c813a58db59" released by "_delete_snapshot" :: held 1.903s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" released by "delete_snapshot" :: held 1.943s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Created reservations ['b4195e96-184a-4395-8279-34d3fed80561', '26d3e0c0-0aa9-4f58-9dfb-16496c17b01f', 'b7379ac2-0584-40f4-b304-e2867d91f2ef', '58b99799-8e33-4db6-9f4c-b538fa7dacc3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Delete snapshot completed successfully. Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f2b716e2-3b6c-465d-b85d-4f39a267e85a tempest-ProjectReaderTests-7839902 None] Lock "cinder-6167cae1-df68-4d3f-93da-9c813a58db59-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-c89785b9-9008-4e96-bfe9-a5837a9805ca-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "cinder-c89785b9-9008-4e96-bfe9-a5837a9805ca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" acquired by "delete_volume" :: waited 0.047s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[03793b12-9fd4-45cd-b1a3-291bc3beae5d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:02 devstack sudo[112931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca Aug 03 09:16:02 devstack sudo[112931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:02 devstack sudo[112931]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca" returned: 0 in 0.538s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:02 devstack sudo[112936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca Aug 03 09:16:02 devstack sudo[112936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:02 devstack sudo[112936]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c89785b9-9008-4e96-bfe9-a5837a9805ca" returned: 0 in 0.326s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-c89785b9-9008-4e96-bfe9-a5837a9805ca" released by "delete_volume" :: held 0.982s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Created reservations ['70759a99-576f-41ff-bc05-8afaa66ca839', '2f5cbeab-2566-4d8e-ba70-f8dfe5579642', 'a8e17932-1ed7-485e-808e-1e6daf322e5d', '4feb1ff5-94b7-4232-bde5-b3ac98be520f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:03 devstack sudo[112939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:03 devstack sudo[112939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (45d4a6ac-2475-45c1-873a-f3ef12145f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835286d9-1d28-43a5-b8d7-c6f0edf8c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack sudo[112939]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835286d9-1d28-43a5-b8d7-c6f0edf8c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367825335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3946b4a7-e11e-4105-a300-c768929f6b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:03Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c42320-de1e-490d-a11d-8e63a48e954a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c42320-de1e-490d-a11d-8e63a48e954a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ee15bf-e37e-4357-b4cd-5a7ac429fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ee15bf-e37e-4357-b4cd-5a7ac429fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3946b4a7-e11e-4105-a300-c768929f6b9d', 'volume_name': 'volume-3946b4a7-e11e-4105-a300-c768929f6b9d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fd134c-6088-43f3-9936-0e27cb10d599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fd134c-6088-43f3-9936-0e27cb10d599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14c3190-9bdb-4618-ba81-99e116426746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Volume 3946b4a7-e11e-4105-a300-c768929f6b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3946b4a7-e11e-4105-a300-c768929f6b9d', 'volume_size': 1} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1367825335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3946b4a7-e11e-4105-a300-c768929f6b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:03Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Creating volume 3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:03 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Deleted volume successfully. Aug 03 09:16:03 devstack sudo[112942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d 1073741824 Aug 03 09:16:03 devstack sudo[112942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285482c9-8abb-4f39-886e-5799760632c9 tempest-ProjectReaderTests-7839902 None] Lock "cinder-c89785b9-9008-4e96-bfe9-a5837a9805ca-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (b705d8d3-cb3f-47e5-b7db-6cb2a04eefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb729b85-e070-40bc-9f6f-d0a8009fca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb729b85-e070-40bc-9f6f-d0a8009fca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e019e883-8208-40da-ae57-229d79af9ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:04Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a0406f-566e-4858-b242-1b3614f4c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67a0406f-566e-4858-b242-1b3614f4c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cbb5bd-79ea-4f5c-8dee-67789a7aac5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (bba5c41a-4375-4331-9311-5f69a867ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eda8fa-b945-4430-a04c-264f99b8626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49eda8fa-b945-4430-a04c-264f99b8626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138229999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bbf83e-b7ed-436d-bc91-01c62d0c8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:04Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540ccf91-c07a-4fc7-bf7c-6c281e5a8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (540ccf91-c07a-4fc7-bf7c-6c281e5a8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234bc3e3-eb3b-4046-84ab-e2bfc84e128f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234bc3e3-eb3b-4046-84ab-e2bfc84e128f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81bbf83e-b7ed-436d-bc91-01c62d0c8710', 'volume_name': 'volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0b2b93-7650-414e-9062-bf49aa428493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0b2b93-7650-414e-9062-bf49aa428493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9195ef-4b33-47a4-ab46-074c96195517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Volume 81bbf83e-b7ed-436d-bc91-01c62d0c8710: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710', 'volume_size': 1} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:04 devstack sudo[112942]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d 1073741824" returned: 0 in 0.673s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:04 devstack sudo[112948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:04 devstack sudo[112948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54cbb5bd-79ea-4f5c-8dee-67789a7aac5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e019e883-8208-40da-ae57-229d79af9ac1', 'volume_name': 'volume-e019e883-8208-40da-ae57-229d79af9ac1', 'volume_size': 1, 'image_id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7542e1be675dcb33db9eb89ce673c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a3ae44c5a844a1ff810229a18fa6e9230062f4288d4ad11307c200437a4edab40a5077db41c57e499fc5e1b94dc4d178de67a8eee1a1d45238b3cd68d39df5', 'id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e32db-504d-436f-9c9d-37f84ae444d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e32db-504d-436f-9c9d-37f84ae444d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928e0c69-c479-49be-bec6-a10ad9f915e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Volume e019e883-8208-40da-ae57-229d79af9ac1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e019e883-8208-40da-ae57-229d79af9ac1', 'volume_size': 1, 'image_id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7542e1be675dcb33db9eb89ce673c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a3ae44c5a844a1ff810229a18fa6e9230062f4288d4ad11307c200437a4edab40a5077db41c57e499fc5e1b94dc4d178de67a8eee1a1d45238b3cd68d39df5', 'id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a/file', 'properties': {}}, 'image_service': } Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Trying to clone e019e883-8208-40da-ae57-229d79af9ac1 from image cb6adfa7-e015-4fe4-9745-b2f803cc596a at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4120f037-ae58-4955-ace8-62ee8b7641e5]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:04 devstack sudo[112948]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.533s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138229999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bbf83e-b7ed-436d-bc91-01c62d0c8710,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:04Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Creating volume 81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14c3190-9bdb-4618-ba81-99e116426746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3946b4a7-e11e-4105-a300-c768929f6b9d', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8bd0f6-b450-4b6a-b7d2-181643d03769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:04 devstack sudo[112952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 1073741824 Aug 03 09:16:04 devstack sudo[112952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:04 devstack sudo[112951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Volume volume-3946b4a7-e11e-4105-a300-c768929f6b9d (3946b4a7-e11e-4105-a300-c768929f6b9d): created successfully Aug 03 09:16:04 devstack sudo[112951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae8bd0f6-b450-4b6a-b7d2-181643d03769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (45d4a6ac-2475-45c1-873a-f3ef12145f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-90195ea0-6332-4483-bf23-3a341b1ce888 tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:16:04 devstack sudo[112951]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:04 devstack sudo[112958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:04 devstack sudo[112958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:05 devstack sudo[112952]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 1073741824" returned: 0 in 0.560s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:05 devstack sudo[112963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 Aug 03 09:16:05 devstack sudo[112963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:05 devstack sudo[112958]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 1 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Temporary image cb6adfa7-e015-4fe4-9745-b2f803cc596a is fetched for user f707fbd9908744f7b51191626725df12. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8edfcb8-fc15-480d-9861-e6b7989028f9]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:05 devstack sudo[112963]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9195ef-4b33-47a4-ab46-074c96195517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b948bc5d-ed6c-4d01-a154-8545d052edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:05 devstack sudo[112968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:05 devstack sudo[112968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:05 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Volume volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 (81bbf83e-b7ed-436d-bc91-01c62d0c8710): created successfully Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b948bc5d-ed6c-4d01-a154-8545d052edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (bba5c41a-4375-4331-9311-5f69a867ec17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-653bafec-6213-46ed-a0d9-de18905f8a64 tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot caab1e19-cccf-45da-92bd-919e477f1c04 of volume 3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d503b41b-bc99-41ac-82b5-0dd9001ba197]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:05 devstack sudo[112971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:05 devstack sudo[112971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:05 devstack sudo[112968]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:06 devstack sudo[112975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:06 devstack sudo[112975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:06 devstack sudo[112971]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.445s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:06 devstack sudo[112980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 1G Aug 03 09:16:06 devstack sudo[112980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:06 devstack sudo[112975]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 1 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (d20b9064-e193-4ad1-aea4-5e453831bde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9da87f0-576c-4327-8ad6-4e56ed1eb4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9da87f0-576c-4327-8ad6-4e56ed1eb4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892710426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398ff061-acb3-4c38-a07f-bac69bdc34c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:06Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395fdf9-c745-4053-babb-12337befc13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395fdf9-c745-4053-babb-12337befc13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72fff44-662f-4cf7-bf97-a8bef6b07765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72fff44-662f-4cf7-bf97-a8bef6b07765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398ff061-acb3-4c38-a07f-bac69bdc34c5', 'volume_name': 'volume-398ff061-acb3-4c38-a07f-bac69bdc34c5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9106db-6f5d-416f-b63a-f16130bbf3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9106db-6f5d-416f-b63a-f16130bbf3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a99c30c-a5c2-4cf9-9217-031ec8f08690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:06 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume 398ff061-acb3-4c38-a07f-bac69bdc34c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398ff061-acb3-4c38-a07f-bac69bdc34c5', 'volume_size': 1} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:06 devstack sudo[112980]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 1G" returned: 0 in 0.431s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3946b4a7-e11e-4105-a300-c768929f6b9d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:06 devstack sudo[112989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3946b4a7-e11e-4105-a300-c768929f6b9d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:06 devstack sudo[112989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:06 devstack sudo[112989]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3946b4a7-e11e-4105-a300-c768929f6b9d -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.328s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:06 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 is being set with open permissions: ugo+rw Aug 03 09:16:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:06 devstack sudo[112994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:06 devstack sudo[112994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:07 devstack sudo[112994]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:07 devstack sudo[112997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info Aug 03 09:16:07 devstack sudo[112997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:07 devstack sudo[112997]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:07 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info is being set with open permissions: ugo+rw Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:07 devstack sudo[113000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info Aug 03 09:16:07 devstack sudo[113000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:07 devstack sudo[113000]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.info" returned: 0 in 0.270s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.586s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 2a860f69-1686-4715-9e5b-a465ab78b10b of volume 81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f3ee494e-a162-4b76-99fa-9f548ce57b45 tempest-VolumeDependencyTests-878745567 None] Create snapshot completed successfully Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c6d00e-fd94-4a11-91ad-367534c1258b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:07 devstack sudo[113003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 Aug 03 09:16:07 devstack sudo[113003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:08 devstack sudo[113003]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710" returned: 0 in 0.363s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:08 devstack sudo[113008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b 1G Aug 03 09:16:08 devstack sudo[113008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:08 devstack sudo[113008]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b 1G" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:08 devstack sudo[113013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b Aug 03 09:16:08 devstack sudo[113013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:08 devstack sudo[113018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:08 devstack sudo[113018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:08 devstack sudo[113013]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b" returned: 0 in 0.323s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:08 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b is being set with open permissions: ugo+rw Aug 03 09:16:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:08 devstack sudo[113021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b Aug 03 09:16:08 devstack sudo[113021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:09 devstack sudo[113018]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:16:09 devstack sudo[113021]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b" returned: 0 in 0.303s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:09 devstack sudo[113025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info Aug 03 09:16:09 devstack sudo[113025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (58609122-3f19-4dfb-aa52-211fd511b2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0075b4-2d83-4ed6-ac6d-42242a9506ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0075b4-2d83-4ed6-ac6d-42242a9506ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-815655050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eaf69a7-f891-4890-b140-dc713f08e2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=caab1e19-cccf-45da-92bd-919e477f1c04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:09Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e482b8f1-2afa-4bc2-bed2-1f37a6e11f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e482b8f1-2afa-4bc2-bed2-1f37a6e11f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176bfab5-012e-423f-8996-3c6e12e1467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:09 devstack sudo[113025]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176bfab5-012e-423f-8996-3c6e12e1467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7eaf69a7-f891-4890-b140-dc713f08e2b6', 'volume_name': 'volume-7eaf69a7-f891-4890-b140-dc713f08e2b6', 'volume_size': 1, 'snapshot_id': 'caab1e19-cccf-45da-92bd-919e477f1c04'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e4c1fe-283c-47d9-ae57-f50f12747028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e4c1fe-283c-47d9-ae57-f50f12747028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c94632-b903-49db-b04c-f4ef00dcce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Volume 7eaf69a7-f891-4890-b140-dc713f08e2b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7eaf69a7-f891-4890-b140-dc713f08e2b6', 'volume_size': 1, 'snapshot_id': 'caab1e19-cccf-45da-92bd-919e477f1c04'} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info" returned: 0 in 0.313s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:09 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info is being set with open permissions: ugo+rw Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:09 devstack sudo[113028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info Aug 03 09:16:09 devstack sudo[113028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:09 devstack sudo[113028]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.info" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.512s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e019e883-8208-40da-ae57-229d79af9ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:04Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Creating volume e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:09 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:09 devstack sudo[113031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1073741824 Aug 03 09:16:09 devstack sudo[113031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6e5e5a63-8914-4cda-b3c4-ed2cc476959f tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:16:10 devstack sudo[113031]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1073741824" returned: 0 in 0.455s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-2a860f69-1686-4715-9e5b-a465ab78b10b-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-2a860f69-1686-4715-9e5b-a465ab78b10b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-2a860f69-1686-4715-9e5b-a465ab78b10b" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-2a860f69-1686-4715-9e5b-a465ab78b10b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Deleting offline snapshot 2a860f69-1686-4715-9e5b-a465ab78b10b of volume 81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:10 devstack sudo[113037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:10 devstack sudo[113037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] snapshot_file for this snap is: volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3c71b-dbcc-4860-b1b5-8cec46563e81]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:10 devstack sudo[113039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b Aug 03 09:16:10 devstack sudo[113039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:10 devstack sudo[113037]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.219s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-892710426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398ff061-acb3-4c38-a07f-bac69bdc34c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:06Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume 398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:10 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:10 devstack sudo[113042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 1073741824 Aug 03 09:16:10 devstack sudo[113042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Attempting download of cb6adfa7-e015-4fe4-9745-b2f803cc596a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}])) to volume e019e883-8208-40da-ae57-229d79af9ac1. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb472bf-af3b-49e0-ac50-78485796f30c]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:10 devstack sudo[113039]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b" returned: 0 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfa681d-0885-4b10-83a3-e7c2d334405b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:10 devstack sudo[113046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o Aug 03 09:16:10 devstack sudo[113046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:10 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 Aug 03 09:16:10 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113046]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack sudo[113042]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 1073741824" returned: 0 in 0.508s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack sudo[113060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 Aug 03 09:16:11 devstack sudo[113060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o Aug 03 09:16:11 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710" returned: 0 in 0.426s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack sudo[113064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b Aug 03 09:16:11 devstack sudo[113064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113060]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.910s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04-7eaf69a7-f891-4890-b140-dc713f08e2b6" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a99c30c-a5c2-4cf9-9217-031ec8f08690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398ff061-acb3-4c38-a07f-bac69bdc34c5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:11 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faceaf1-cace-4e7d-8083-988b52c7fa9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o" returned: 1 in 0.368s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb6adfa7-e015-4fe4-9745-b2f803cc596a_t6oq__5o' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 (398ff061-acb3-4c38-a07f-bac69bdc34c5): created successfully Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6faceaf1-cace-4e7d-8083-988b52c7fa9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (d20b9064-e193-4ad1-aea4-5e453831bde6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04-7eaf69a7-f891-4890-b140-dc713f08e2b6" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Creating volume 7eaf69a7-f891-4890-b140-dc713f08e2b6 from snapshot caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5c311b-1086-4cb3-8116-395b2c297dc6]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64c0607a-7188-4050-85cc-3f6291886be2 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] snapshot: caab1e19-cccf-45da-92bd-919e477f1c04, volume: 7eaf69a7-f891-4890-b140-dc713f08e2b6, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3dbfc7-6c84-4446-ac6b-8f8788391f63]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack sudo[113071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:11 devstack sudo[113071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113064]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b" returned: 0 in 0.433s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:11 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b Aug 03 09:16:11 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack sudo[113073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:11 devstack sudo[113073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:11 devstack sudo[113071]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710.2a860f69-1686-4715-9e5b-a465ab78b10b" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-2a860f69-1686-4715-9e5b-a465ab78b10b" released by "_delete_snapshot" :: held 1.684s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" released by "delete_snapshot" :: held 1.714s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:12 devstack sudo[113080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD Aug 03 09:16:12 devstack sudo[113080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Created reservations ['37690373-538c-48a9-a188-ccf30f4226a5', '7e3975c7-993d-494a-9460-28a04f622196', '84b46659-d9a5-4032-921e-a588d81d7073', '45236bda-4ae3-4007-9522-6fc8bca10b3f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:12 devstack sudo[113073]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3946b4a7-e11e-4105-a300-c768929f6b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7eedfd5-96af-46de-b60b-7d60d6b429e4]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Delete snapshot completed successfully. Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c4c33866-f118-4ecd-be52-e2fd4a647486 tempest-ProjectReaderTests-7839902 None] Lock "cinder-2a860f69-1686-4715-9e5b-a465ab78b10b-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:12 devstack sudo[113086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:12 devstack sudo[113086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:12 devstack sudo[113080]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD" returned: 1 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] cb6adfa7-e015-4fe4-9745-b2f803cc596a was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack sudo[113091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:12 devstack sudo[113091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-81bbf83e-b7ed-436d-bc91-01c62d0c8710-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "cinder-81bbf83e-b7ed-436d-bc91-01c62d0c8710-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:12 devstack sudo[113086]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffcfdb3-9c53-4d9e-83b9-8f244f0a7aa9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack sudo[113099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:12 devstack sudo[113099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:12 devstack sudo[113100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 Aug 03 09:16:12 devstack sudo[113100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:12 devstack sudo[113091]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb6adfa7-e015-4fe4-9745-b2f803cc596a_6sw6qir7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:12 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:16:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:12 devstack sudo[113104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1G Aug 03 09:16:12 devstack sudo[113104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:13 devstack sudo[113100]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710" returned: 0 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:13 devstack sudo[113115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710 Aug 03 09:16:13 devstack sudo[113115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:13 devstack sudo[113104]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 1G" returned: 0 in 0.320s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Downloaded image cb6adfa7-e015-4fe4-9745-b2f803cc596a ((None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}])) to volume e019e883-8208-40da-ae57-229d79af9ac1 successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Temporary image cb6adfa7-e015-4fe4-9745-b2f803cc596a for user f707fbd9908744f7b51191626725df12 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Marking volume e019e883-8208-40da-ae57-229d79af9ac1 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Copying metadata from image cb6adfa7-e015-4fe4-9745-b2f803cc596a to e019e883-8208-40da-ae57-229d79af9ac1. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Creating volume glance metadata for volume e019e883-8208-40da-ae57-229d79af9ac1 backed by image cb6adfa7-e015-4fe4-9745-b2f803cc596a with: {'image_id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'image_name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'checksum': 'c7542e1be675dcb33db9eb89ce673c75', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:16:13 devstack sudo[113115]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-81bbf83e-b7ed-436d-bc91-01c62d0c8710" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928e0c69-c479-49be-bec6-a10ad9f915e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e019e883-8208-40da-ae57-229d79af9ac1', 'volume_size': 1, 'image_id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7542e1be675dcb33db9eb89ce673c75', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62a3ae44c5a844a1ff810229a18fa6e9230062f4288d4ad11307c200437a4edab40a5077db41c57e499fc5e1b94dc4d178de67a8eee1a1d45238b3cd68d39df5', 'id': 'cb6adfa7-e015-4fe4-9745-b2f803cc596a', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb6adfa7-e015-4fe4-9745-b2f803cc596a/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5a727b-fc87-44a5-9b4e-629922ea9b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-81bbf83e-b7ed-436d-bc91-01c62d0c8710" released by "delete_volume" :: held 1.010s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Volume volume-e019e883-8208-40da-ae57-229d79af9ac1 (e019e883-8208-40da-ae57-229d79af9ac1): created successfully Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b5a727b-fc87-44a5-9b4e-629922ea9b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (b705d8d3-cb3f-47e5-b7db-6cb2a04eefe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-31560776-085e-4ddd-ab36-621095765645 tempest-VolumeImageDependencyTests-1527199520 None] Created volume successfully. Aug 03 09:16:13 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Created reservations ['5602ecdb-3742-43d1-87a6-2c3ec6167108', '2894373e-76ea-4e8e-8dc0-3e20dd736ee0', '3d11f625-d6e0-48c4-bb02-9a16d12c6412', 'af8ac6e0-68de-44a5-9562-29644c729247'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:14 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:14 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:14 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.663s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Deleted volume successfully. Aug 03 09:16:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4d4575cf-94bf-4683-9043-060c689d7ab3 tempest-ProjectReaderTests-7839902 None] Lock "cinder-81bbf83e-b7ed-436d-bc91-01c62d0c8710-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (3feb1f9a-8b99-49a7-bee3-4a92f8114ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccdba70-1656-4ea4-88e8-f8f531ed4ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ccdba70-1656-4ea4-88e8-f8f531ed4ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-0e20bd6e-440f-41d8-9b5d-fc047ac00423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5dfda1-c03b-4f70-b8d2-6612274cd1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e019e883-8208-40da-ae57-229d79af9ac1,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:16Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73c5708-20aa-4bd2-978c-462f6c3fbf57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a73c5708-20aa-4bd2-978c-462f6c3fbf57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a898b91-1be6-48a8-bef6-394b21213a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a898b91-1be6-48a8-bef6-394b21213a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cc5dfda1-c03b-4f70-b8d2-6612274cd1fb', 'volume_name': 'volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb', 'volume_size': 1, 'source_volid': 'e019e883-8208-40da-ae57-229d79af9ac1', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed42f12-35f5-4a57-a72b-d5160e60be89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed42f12-35f5-4a57-a72b-d5160e60be89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e963872-20a8-4550-a895-c808831a9277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Volume cc5dfda1-c03b-4f70-b8d2-6612274cd1fb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb', 'volume_size': 1, 'source_volid': 'e019e883-8208-40da-ae57-229d79af9ac1', 'source_volstatus': 'available'} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (a0b9ebdf-d88b-4654-942d-178e6a76b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2e9642-800b-4d5a-9818-42b696d2edcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a2e9642-800b-4d5a-9818-42b696d2edcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341809104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f181b8a2-3c38-4d04-a01e-0ba902fe5726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:17Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab9d213-df73-406f-b21d-f7b8f11d44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab9d213-df73-406f-b21d-f7b8f11d44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9989caa3-8bae-48f3-843e-00a4ed1ae3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9989caa3-8bae-48f3-843e-00a4ed1ae3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f181b8a2-3c38-4d04-a01e-0ba902fe5726', 'volume_name': 'volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f68a9d6-d8d9-4140-b5cc-91417e4aa903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f68a9d6-d8d9-4140-b5cc-91417e4aa903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada1f397-3e46-4ba0-98b9-e9dd6afc6ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Volume f181b8a2-3c38-4d04-a01e-0ba902fe5726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726', 'volume_size': 1} Aug 03 09:16:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:17 devstack sudo[113099]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 5.114s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:17 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:17 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 200.21 MB/s Aug 03 09:16:17 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 is being set with open permissions: ugo+rw Aug 03 09:16:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:17 devstack sudo[113129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:17 devstack sudo[113129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:18 devstack sudo[113129]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" released by "_copy_volume_from_snapshot" :: held 6.448s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04-7eaf69a7-f891-4890-b140-dc713f08e2b6" released by "_create_volume_from_snapshot" :: held 6.543s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.593s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.184s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating offline snapshot 691a6e1f-6511-4f94-9b55-3516d0ccdd0d of volume 398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4c94632-b903-49db-b04c-f4ef00dcce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eaf69a7-f891-4890-b140-dc713f08e2b6', 'volume_size': 1, 'snapshot_id': 'caab1e19-cccf-45da-92bd-919e477f1c04'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc554c0-c07d-49bc-b8ab-9f088861611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f925c33c-0aa6-4b29-9964-7dfce6f94d47]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:18 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Volume volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 (7eaf69a7-f891-4890-b140-dc713f08e2b6): created successfully Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc554c0-c07d-49bc-b8ab-9f088861611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (58609122-3f19-4dfb-aa52-211fd511b2c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ac7ba537-5c46-4b06-abfb-e8b7c811286f tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:16:18 devstack sudo[113132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 Aug 03 09:16:18 devstack sudo[113132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:18 devstack sudo[113132]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:18 devstack sudo[113137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d 1G Aug 03 09:16:18 devstack sudo[113137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:18 devstack sudo[113137]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d 1G" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:18 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d Aug 03 09:16:18 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:19 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d is being set with open permissions: ugo+rw Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:19 devstack sudo[113149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d Aug 03 09:16:19 devstack sudo[113149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:19 devstack sudo[113149]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:19 devstack sudo[113152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info Aug 03 09:16:19 devstack sudo[113152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:19 devstack sudo[113152]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:19 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info is being set with open permissions: ugo+rw Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:19 devstack sudo[113155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info Aug 03 09:16:19 devstack sudo[113155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:19 devstack sudo[113155]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.info" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.263s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:19 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Cloning volume e019e883-8208-40da-ae57-229d79af9ac1 to volume cc5dfda1-c03b-4f70-b8d2-6612274cd1fb Aug 03 09:16:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e80c5670-741c-411e-90be-0548290f0297 tempest-CreateVolumesFromSnapshotTest-72092298 None] Create snapshot completed successfully Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Creating offline snapshot 41602f3d-6d6d-4cd7-8de7-be872ea9cc77 of volume e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afb2427-4f81-4d36-a7e8-5c4986b937fb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:20 devstack sudo[113158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:20 devstack sudo[113158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:20 devstack sudo[113158]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:20 devstack sudo[113163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 1G Aug 03 09:16:20 devstack sudo[113163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:20 devstack sudo[113163]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 1G" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e019e883-8208-40da-ae57-229d79af9ac1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:20 devstack sudo[113169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e019e883-8208-40da-ae57-229d79af9ac1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:20 devstack sudo[113169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:21 devstack sudo[113169]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e019e883-8208-40da-ae57-229d79af9ac1 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 is being set with open permissions: ugo+rw Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:21 devstack sudo[113174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:21 devstack sudo[113174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:21 devstack sudo[113174]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.268s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:21 devstack sudo[113177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info Aug 03 09:16:21 devstack sudo[113177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (ac52841c-d7b1-4080-b7c0-a1c2caae4032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1854180-3077-4c85-a43b-9d531d18dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1854180-3077-4c85-a43b-9d531d18dc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125568497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8440128c-9056-4a76-8ac2-3ece705f77bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:21Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7eea7c-2b5b-4531-9ba1-97f5a489c099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a7eea7c-2b5b-4531-9ba1-97f5a489c099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e6637-22bb-48f5-846a-ddc994c9909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930e6637-22bb-48f5-846a-ddc994c9909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8440128c-9056-4a76-8ac2-3ece705f77bc', 'volume_name': 'volume-8440128c-9056-4a76-8ac2-3ece705f77bc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dbb166-5ca4-413a-959d-b7691598b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dbb166-5ca4-413a-959d-b7691598b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc37d0c0-ed23-4094-a925-b6df3a8fae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume 8440128c-9056-4a76-8ac2-3ece705f77bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8440128c-9056-4a76-8ac2-3ece705f77bc', 'volume_size': 1} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:21 devstack sudo[113177]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:21 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info is being set with open permissions: ugo+rw Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:21 devstack sudo[113180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info Aug 03 09:16:21 devstack sudo[113180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (7063f8f7-f041-4981-8e50-258a1439d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b00fc-daf0-468e-86f8-f8937b60fa26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a00b00fc-daf0-468e-86f8-f8937b60fa26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040857800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50957c04-5492-4414-a87c-ce6b95969bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:22Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd8124e-91ea-45d5-8ac6-d5f74e5535f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack sudo[113180]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd8124e-91ea-45d5-8ac6-d5f74e5535f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d513d1-b388-481e-b9ed-e2456a56a2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d513d1-b388-481e-b9ed-e2456a56a2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50957c04-5492-4414-a87c-ce6b95969bf0', 'volume_name': 'volume-50957c04-5492-4414-a87c-ce6b95969bf0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498d75c6-2d71-48ee-8149-a859861e67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (498d75c6-2d71-48ee-8149-a859861e67a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d7b10-7887-4eb5-a8ab-3142d03b09ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume 50957c04-5492-4414-a87c-ce6b95969bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50957c04-5492-4414-a87c-ce6b95969bf0', 'volume_size': 1} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.info" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] snapshot: 41602f3d-6d6d-4cd7-8de7-be872ea9cc77, volume: cc5dfda1-c03b-4f70-b8d2-6612274cd1fb, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71cc755-876a-4e46-9c30-b298bb0c3484]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:22 devstack sudo[113184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:22 devstack sudo[113184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (b3258c80-4a85-452a-a3e7-cc60b619a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797b1d91-8cd6-4add-a69f-a53473d9067e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (797b1d91-8cd6-4add-a69f-a53473d9067e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511454841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022d768c-f3f0-4a0e-a28a-2841b7a095a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:22Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f1086e-287a-4bcc-a2d2-9089ea02c4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f1086e-287a-4bcc-a2d2-9089ea02c4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d563d3-4afc-430e-b8c8-b3f5e7d0221a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d563d3-4afc-430e-b8c8-b3f5e7d0221a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022d768c-f3f0-4a0e-a28a-2841b7a095a0', 'volume_name': 'volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f718eb-0fdb-421a-8307-09036d20cb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f718eb-0fdb-421a-8307-09036d20cb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1427203d-c06f-41f1-99db-a965d60154fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume 022d768c-f3f0-4a0e-a28a-2841b7a095a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0', 'volume_size': 1} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:22 devstack sudo[113184]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e019e883-8208-40da-ae57-229d79af9ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54cd13e-a093-4873-93a7-566a40816c29]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:22 devstack sudo[113189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:22 devstack sudo[113189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (892faf8a-3296-4364-bd20-82a1437f0ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011f285e-8d6d-4877-873c-1446ed3f184a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011f285e-8d6d-4877-873c-1446ed3f184a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356825612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0548f89-c1a0-45a4-ad1b-6d885bdb74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:23Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88deb4fb-44d0-47ea-9709-6ad002c52c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88deb4fb-44d0-47ea-9709-6ad002c52c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ea6130-9d1d-44ae-9551-f460244a40ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ea6130-9d1d-44ae-9551-f460244a40ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0548f89-c1a0-45a4-ad1b-6d885bdb74f1', 'volume_name': 'volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e36445-1bbd-464f-a853-fdf9d8c68471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e36445-1bbd-464f-a853-fdf9d8c68471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deca8d1-1fc6-4a31-8758-83e6fc182409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume d0548f89-c1a0-45a4-ad1b-6d885bdb74f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1', 'volume_size': 1} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:22 devstack sudo[113189]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.413s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:22 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb Aug 03 09:16:22 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (d9e80d16-5a55-45cd-a11d-c84360310d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da88038-30f0-49e6-86fa-b65ef5f17c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da88038-30f0-49e6-86fa-b65ef5f17c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770551088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24f3c58-44c3-4566-89b1-3dc1d54d7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:23Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db1f854-b4a5-4a0e-959e-c688ac5b74fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db1f854-b4a5-4a0e-959e-c688ac5b74fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542c9e52-abaa-496b-ba98-b1284c3884b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542c9e52-abaa-496b-ba98-b1284c3884b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24f3c58-44c3-4566-89b1-3dc1d54d7577', 'volume_name': 'volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7374d00b-e2a5-4830-8708-230213913dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7374d00b-e2a5-4830-8708-230213913dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304eb8c0-ca29-47d2-8afa-bf1fb9f5cbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:23 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume c24f3c58-44c3-4566-89b1-3dc1d54d7577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577', 'volume_size': 1} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:23 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" returned: 0 in 0.472s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:23 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:16:23 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb is being set with open permissions: ugo+rw Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:23 devstack sudo[113200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb Aug 03 09:16:23 devstack sudo[113200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:23 devstack sudo[113200]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" released by "_copy_volume_from_snapshot" :: held 1.614s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-41602f3d-6d6d-4cd7-8de7-be872ea9cc77" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-41602f3d-6d6d-4cd7-8de7-be872ea9cc77" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Deleting offline snapshot 41602f3d-6d6d-4cd7-8de7-be872ea9cc77 of volume e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] snapshot_file for this snap is: volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7655a2be-8511-4433-b770-db52180fff77]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:23 devstack sudo[113203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:23 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:23 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e019e883-8208-40da-ae57-229d79af9ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6546470b-ed67-4993-ae04-86e091525310]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:24 devstack sudo[113208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:24 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:24 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:24 devstack sudo[113213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:24 devstack sudo[113213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:24 devstack sudo[113213]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:24 devstack sudo[113218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77 Aug 03 09:16:24 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:24 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1.41602f3d-6d6d-4cd7-8de7-be872ea9cc77" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-41602f3d-6d6d-4cd7-8de7-be872ea9cc77" released by "_delete_snapshot" :: held 1.370s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.066s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Marking volume cc5dfda1-c03b-4f70-b8d2-6612274cd1fb as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.144s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341809104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f181b8a2-3c38-4d04-a01e-0ba902fe5726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:17Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Creating volume f181b8a2-3c38-4d04-a01e-0ba902fe5726 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:25 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Copying metadata from source volume e019e883-8208-40da-ae57-229d79af9ac1 to cc5dfda1-c03b-4f70-b8d2-6612274cd1fb. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:438}} Aug 03 09:16:25 devstack sudo[113221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 1073741824 Aug 03 09:16:25 devstack sudo[113221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e963872-20a8-4550-a895-c808831a9277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb', 'volume_size': 1, 'source_volid': 'e019e883-8208-40da-ae57-229d79af9ac1', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6b48ec-083a-44fa-90f0-47297a5e729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Volume volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb (cc5dfda1-c03b-4f70-b8d2-6612274cd1fb): created successfully Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe6b48ec-083a-44fa-90f0-47297a5e729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (3feb1f9a-8b99-49a7-bee3-4a92f8114ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ff81701b-44f9-4092-913b-5bb2c74c4cac tempest-VolumeImageDependencyTests-1527199520 None] Created volume successfully. Aug 03 09:16:25 devstack sudo[113221]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 1073741824" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:25 devstack sudo[113226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 Aug 03 09:16:25 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-e019e883-8208-40da-ae57-229d79af9ac1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-e019e883-8208-40da-ae57-229d79af9ac1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-e019e883-8208-40da-ae57-229d79af9ac1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-e019e883-8208-40da-ae57-229d79af9ac1" acquired by "delete_volume" :: waited 0.039s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:25 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726" returned: 0 in 0.322s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.268s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot 9b8f7944-a93a-4945-969c-144c946aea74 of volume 7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[83978dd5-35b0-4e2f-9612-a750a88f8389]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada1f397-3e46-4ba0-98b9-e9dd6afc6ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1eeb4-7c9a-48c1-b721-48ad631d8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6703ec64-5187-4926-959e-ca968f36cfe2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:25 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Volume volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 (f181b8a2-3c38-4d04-a01e-0ba902fe5726): created successfully Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1eeb4-7c9a-48c1-b721-48ad631d8f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (a0b9ebdf-d88b-4654-942d-178e6a76b124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b7dd9937-ff76-4088-91cc-c4b4f8a4c45c tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:16:25 devstack sudo[113229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:25 devstack sudo[113229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:26 devstack sudo[113230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113229]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:26 devstack sudo[113230]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:26 devstack sudo[113239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1 Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.381s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:26 devstack sudo[113239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 1G Aug 03 09:16:26 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113239]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e019e883-8208-40da-ae57-229d79af9ac1" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-e019e883-8208-40da-ae57-229d79af9ac1" released by "delete_volume" :: held 0.739s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['375ae667-0647-4b8f-945a-e57cc1730f0d', '807e3006-bf98-4bda-9233-2910fa4a9bab', '974f9a7c-a6de-45b9-bc20-c82b00bdc04b', 'fbcc2445-6a39-4a5d-a898-e613f82e2852'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:26 devstack sudo[113247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:26 devstack sudo[113247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 1G" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:26 devstack sudo[113250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:26 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:26 devstack sudo[113247]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Deleted volume successfully. Aug 03 09:16:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-970c6fa3-5613-4bec-863c-977d537624bf tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-e019e883-8208-40da-ae57-229d79af9ac1-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:27 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.369s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:27 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 is being set with open permissions: ugo+rw Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:27 devstack sudo[113257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:27 devstack sudo[113257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:27 devstack sudo[113257]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:27 devstack sudo[113260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info Aug 03 09:16:27 devstack sudo[113260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:27 devstack sudo[113260]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:27 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info is being set with open permissions: ugo+rw Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:27 devstack sudo[113263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info Aug 03 09:16:27 devstack sudo[113263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:27 devstack sudo[113263]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.info" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.366s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1125568497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8440128c-9056-4a76-8ac2-3ece705f77bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:21Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume 8440128c-9056-4a76-8ac2-3ece705f77bc {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:27 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:27 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc 1073741824 Aug 03 09:16:27 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-322a6049-c644-4441-a0bd-8e23feac0b39 tempest-VolumeDependencyTests-878745567 None] Create snapshot completed successfully Aug 03 09:16:28 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc 1073741824" returned: 0 in 0.469s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:28 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc Aug 03 09:16:28 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:28 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.798s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040857800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50957c04-5492-4414-a87c-ce6b95969bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:22Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume 50957c04-5492-4414-a87c-ce6b95969bf0 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:28 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:28 devstack sudo[113276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 1073741824 Aug 03 09:16:28 devstack sudo[113276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc37d0c0-ed23-4094-a925-b6df3a8fae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8440128c-9056-4a76-8ac2-3ece705f77bc', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a84a1d-2080-4628-84ec-805a3795dfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-8440128c-9056-4a76-8ac2-3ece705f77bc (8440128c-9056-4a76-8ac2-3ece705f77bc): created successfully Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a84a1d-2080-4628-84ec-805a3795dfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (ac52841c-d7b1-4080-b7c0-a1c2caae4032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bc3dd8fa-bfb5-4251-b40f-0d7ddcea8d0e tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:29 devstack sudo[113276]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 1073741824" returned: 0 in 0.527s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:29 devstack sudo[113282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 Aug 03 09:16:29 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:29 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.349s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1511454841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022d768c-f3f0-4a0e-a28a-2841b7a095a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:22Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume 022d768c-f3f0-4a0e-a28a-2841b7a095a0 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:29 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 1073741824 Aug 03 09:16:29 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (118cd25d-974a-4672-9a5f-9af08999b4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a45b95-dd62-4e60-a343-2145fc6f80af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10d7b10-7887-4eb5-a8ab-3142d03b09ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50957c04-5492-4414-a87c-ce6b95969bf0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa65ae4c-9ebf-4620-8c33-5223f5e13ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a45b95-dd62-4e60-a343-2145fc6f80af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-166025859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c714497-3ec2-4c62-98f8-5a32495b2e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b8f7944-a93a-4945-969c-144c946aea74,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:30Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de965a56-cf65-4034-b786-ea71cd1684c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de965a56-cf65-4034-b786-ea71cd1684c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d2bfb8-fce7-4f0d-aac8-3984d0b05398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d2bfb8-fce7-4f0d-aac8-3984d0b05398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'volume_name': 'volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'volume_size': 1, 'snapshot_id': '9b8f7944-a93a-4945-969c-144c946aea74'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97a9f19-776f-44bf-904c-b4fd7bd3cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97a9f19-776f-44bf-904c-b4fd7bd3cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0824b02-fb7a-461e-a534-adc6e961aa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Volume 1c714497-3ec2-4c62-98f8-5a32495b2e3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'volume_size': 1, 'snapshot_id': '9b8f7944-a93a-4945-969c-144c946aea74'} Aug 03 09:16:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-50957c04-5492-4414-a87c-ce6b95969bf0 (50957c04-5492-4414-a87c-ce6b95969bf0): created successfully Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa65ae4c-9ebf-4620-8c33-5223f5e13ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (7063f8f7-f041-4981-8e50-258a1439d98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-08b94c20-ec68-425c-8b22-d895f2137c62 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (66a73268-2cbe-44f1-8e99-35187efccb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02fb56a-95d0-4f7d-9a5a-da9da2c40c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02fb56a-95d0-4f7d-9a5a-da9da2c40c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3936eec9-69fe-4ab7-8472-0d720de8591b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:30Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c20eff-5526-4149-b596-3251a23f6fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61c20eff-5526-4149-b596-3251a23f6fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f81f3e7-8ba3-421c-a093-d6a26cc8cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.image.glance [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Creating Keystone auth plugin from conf {{(pid=88796) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 09:16:30 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 1073741824" returned: 0 in 0.494s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:30 devstack sudo[113291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 Aug 03 09:16:30 devstack sudo[113291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f81f3e7-8ba3-421c-a093-d6a26cc8cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3936eec9-69fe-4ab7-8472-0d720de8591b', 'volume_name': 'volume-3936eec9-69fe-4ab7-8472-0d720de8591b', 'volume_size': 1, 'image_id': '40fc83d3-e797-469c-be17-39048e0edda4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0819dc68d09cb2f3cd34eee18c5e32c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac122a2238a8f4ac98fd41f459f1ba62d962167a0aeb1b1744374d4ca22a99c71816d69bbdf61852ef0dbcdc8a7b61f9f7d4c58df9e19b4e394fe4239ec9278', 'id': '40fc83d3-e797-469c-be17-39048e0edda4', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fc83d3-e797-469c-be17-39048e0edda4/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8d83ce-6a59-4fd7-9664-d45501ef3c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8d83ce-6a59-4fd7-9664-d45501ef3c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack sudo[113291]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903a7ba-b460-4e90-8a10-b6b293c6d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Volume 3936eec9-69fe-4ab7-8472-0d720de8591b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3936eec9-69fe-4ab7-8472-0d720de8591b', 'volume_size': 1, 'image_id': '40fc83d3-e797-469c-be17-39048e0edda4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0819dc68d09cb2f3cd34eee18c5e32c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac122a2238a8f4ac98fd41f459f1ba62d962167a0aeb1b1744374d4ca22a99c71816d69bbdf61852ef0dbcdc8a7b61f9f7d4c58df9e19b4e394fe4239ec9278', 'id': '40fc83d3-e797-469c-be17-39048e0edda4', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fc83d3-e797-469c-be17-39048e0edda4/file', 'properties': {}}, 'image_service': } Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Trying to clone 3936eec9-69fe-4ab7-8472-0d720de8591b from image 40fc83d3-e797-469c-be17-39048e0edda4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}]). {{(pid=88796) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.727s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356825612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0548f89-c1a0-45a4-ad1b-6d885bdb74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:23Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1427203d-c06f-41f1-99db-a965d60154fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack sudo[113294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 1073741824 Aug 03 09:16:30 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275f559-9213-4938-821b-8002d9683620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 (022d768c-f3f0-4a0e-a28a-2841b7a095a0): created successfully Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8275f559-9213-4938-821b-8002d9683620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (b3258c80-4a85-452a-a3e7-cc60b619a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f0c23b0b-4fb8-4a24-92d5-3ecd7f32857c tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 09:16:30 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Image download 0.00 MB at 0.00 MB/s Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9cb4fd-1293-4cb4-9e5f-1b66503fd6f4]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:30 devstack sudo[113296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:30 devstack sudo[113296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:30 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 1073741824" returned: 0 in 0.481s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack sudo[113304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 Aug 03 09:16:31 devstack sudo[113304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:31 devstack sudo[113296]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack sudo[113306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:31 devstack sudo[113306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:31 devstack sudo[113304]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.180s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1770551088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24f3c58-44c3-4566-89b1-3dc1d54d7577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e33bc516bb74997973cd837597d168a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:23Z,use_quota=True,user_id='b8564197afbb4c9eab1545018c7b2e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Creating volume c24f3c58-44c3-4566-89b1-3dc1d54d7577 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:31 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3deca8d1-1fc6-4a31-8758-83e6fc182409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:31 devstack sudo[113309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 1073741824 Aug 03 09:16:31 devstack sudo[113309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5535d72-c0a3-418d-ac87-95c781335103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 (d0548f89-c1a0-45a4-ad1b-6d885bdb74f1): created successfully Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5535d72-c0a3-418d-ac87-95c781335103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (892faf8a-3296-4364-bd20-82a1437f0ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d41a0326-a5fe-4005-94f8-426ce7b39043 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:31 devstack sudo[113306]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 1 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Temporary image 40fc83d3-e797-469c-be17-39048e0edda4 is fetched for user f707fbd9908744f7b51191626725df12. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5098b804-7748-4c51-b554-53c5c4f35ed1]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack sudo[113314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:31 devstack sudo[113314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:31 devstack sudo[113309]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 1073741824" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack sudo[113321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 Aug 03 09:16:31 devstack sudo[113321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:31 devstack sudo[113314]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:31 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:31 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:32 devstack sudo[113321]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.813s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 11498d25-3bb1-4b13-9e1a-bb6159e327d6 of volume f181b8a2-3c38-4d04-a01e-0ba902fe5726 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304eb8c0-ca29-47d2-8afa-bf1fb9f5cbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa146f1-8f01-4a72-a134-d991e7ac174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[54351e03-cf12-4fab-97be-c9509bf013fe]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Volume volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 (c24f3c58-44c3-4566-89b1-3dc1d54d7577): created successfully Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa146f1-8f01-4a72-a134-d991e7ac174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Flow 'volume_create_manager' (d9e80d16-5a55-45cd-a11d-c84360310d80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8e3c0348-45a1-4bbd-aaa2-75179eac3ad3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created volume successfully. Aug 03 09:16:32 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 1 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:32 devstack sudo[113327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 Aug 03 09:16:32 devstack sudo[113327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:32 devstack sudo[113327]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:32 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 1G Aug 03 09:16:32 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:32 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 1G" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:32 devstack sudo[113341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 Aug 03 09:16:32 devstack sudo[113341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-c24f3c58-44c3-4566-89b1-3dc1d54d7577-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-c24f3c58-44c3-4566-89b1-3dc1d54d7577-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-c24f3c58-44c3-4566-89b1-3dc1d54d7577" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-c24f3c58-44c3-4566-89b1-3dc1d54d7577" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f265ae6d-5409-4e1b-851f-12786c39d833]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113341]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6" returned: 0 in 0.347s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 is being set with open permissions: ugo+rw Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6 Aug 03 09:16:33 devstack sudo[113347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack sudo[113346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 Aug 03 09:16:33 devstack sudo[113346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack sudo[113347]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.11498d25-3bb1-4b13-9e1a-bb6159e327d6" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info Aug 03 09:16:33 devstack sudo[113354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack sudo[113346]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577 Aug 03 09:16:33 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack sudo[113354]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info is being set with open permissions: ugo+rw Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info Aug 03 09:16:33 devstack sudo[113360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:33 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c24f3c58-44c3-4566-89b1-3dc1d54d7577" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-c24f3c58-44c3-4566-89b1-3dc1d54d7577" released by "delete_volume" :: held 0.662s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['17ecd112-3579-414b-99b8-b048afed1ad5', 'a2d5042f-d6ee-4e00-bb33-9fe56e42a9bb', '6b11c84f-737f-4028-9a73-0ca14b7a919f', 'ecdbccba-5c51-4c13-9a58-b730d1825089'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:33 devstack sudo[113362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:33 devstack sudo[113362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:34 devstack sudo[113360]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f181b8a2-3c38-4d04-a01e-0ba902fe5726.info" returned: 0 in 0.303s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.238s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74-1c714497-3ec2-4c62-98f8-5a32495b2e3c" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74-1c714497-3ec2-4c62-98f8-5a32495b2e3c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Creating volume 1c714497-3ec2-4c62-98f8-5a32495b2e3c from snapshot 9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a6852332-af87-4913-b451-148c0e696d10 tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] snapshot: 9b8f7944-a93a-4945-969c-144c946aea74, volume: 1c714497-3ec2-4c62-98f8-5a32495b2e3c, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b77c5a-ba64-4629-b7fd-34211f7dbd75]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:34 devstack sudo[113362]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.312s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:34 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:34 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0226c598-18dc-473f-85af-27eccc23fa0d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-c24f3c58-44c3-4566-89b1-3dc1d54d7577-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[937b0795-f2dd-4a0a-a9ed-f8e61dd6e0d0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:34 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 Aug 03 09:16:34 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:34 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eaf69a7-f891-4890-b140-dc713f08e2b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad52916c-ab56-43db-b22c-308e9c45052d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a1aefab7-0198-48be-848f-f808406b1c1d tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-11498d25-3bb1-4b13-9e1a-bb6159e327d6-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a1aefab7-0198-48be-848f-f808406b1c1d tempest-ProjectReaderTests-7839902 None] Lock "cinder-11498d25-3bb1-4b13-9e1a-bb6159e327d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:34 devstack cinder-volume[88796]: INFO cinder.message.api [None req-a1aefab7-0198-48be-848f-f808406b1c1d tempest-ProjectReaderTests-7839902 None] Creating message record for request_id = req-a1aefab7-0198-48be-848f-f808406b1c1d Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a1aefab7-0198-48be-848f-f808406b1c1d tempest-ProjectReaderTests-7839902 None] Lock "cinder-11498d25-3bb1-4b13-9e1a-bb6159e327d6-delete_snapshot" released by "delete_snapshot" :: held 0.051s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:34 devstack sudo[113373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:34 devstack sudo[113373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server [None req-a1aefab7-0198-48be-848f-f808406b1c1d tempest-ProjectReaderTests-7839902 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, snapshot, *args, **kwargs) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server return f(*a, **k) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server self.force_reraise() Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server raise self.value Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server self.driver.unmanage_snapshot(snapshot) Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'? Aug 03 09:16:34 devstack cinder-volume[88796]: ERROR oslo_messaging.rpc.server Aug 03 09:16:34 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:34 devstack sudo[113378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1 Aug 03 09:16:34 devstack sudo[113378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:34 devstack sudo[113373]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.400s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:16:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:35 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:35 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:35 devstack sudo[113378]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1" released by "delete_volume" :: held 0.710s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['e684d10f-6c00-401c-a109-b8abd114e4ef', '750352e2-ed74-49a6-ac02-cd12eece3866', '13dd2097-5638-41ac-b7b8-f7ca46ac211c', 'aa8f5c2f-844c-4653-9981-1ec9de914934'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:35 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:35 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:35 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-022d768c-f3f0-4a0e-a28a-2841b7a095a0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=147,cinder:UPDATE=181,cinder:INSERT=67,cinder:DELETE=23 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-022d768c-f3f0-4a0e-a28a-2841b7a095a0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-37d8fa04-5a84-4db5-9787-c15f65d9e60e tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-d0548f89-c1a0-45a4-ad1b-6d885bdb74f1-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-022d768c-f3f0-4a0e-a28a-2841b7a095a0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:35 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.542s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:35 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:16:35 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c is being set with open permissions: ugo+rw Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-022d768c-f3f0-4a0e-a28a-2841b7a095a0" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:35 devstack sudo[113393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:35 devstack sudo[113393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5977c4a0-e116-4077-888f-d1b7eb197cbf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:35 devstack sudo[113395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 Aug 03 09:16:35 devstack sudo[113395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:35 devstack sudo[113393]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" released by "_copy_volume_from_snapshot" :: held 1.699s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74-1c714497-3ec2-4c62-98f8-5a32495b2e3c" released by "_create_volume_from_snapshot" :: held 1.775s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.798s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.695s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-teste6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3936eec9-69fe-4ab7-8472-0d720de8591b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:30Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Creating volume 3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:35 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:35 devstack sudo[113398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1073741824 Aug 03 09:16:35 devstack sudo[113398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0824b02-fb7a-461e-a534-adc6e961aa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'volume_size': 1, 'snapshot_id': '9b8f7944-a93a-4945-969c-144c946aea74'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4c849-43a8-473a-96c8-f002abe3837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Volume volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c (1c714497-3ec2-4c62-98f8-5a32495b2e3c): created successfully Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff4c849-43a8-473a-96c8-f002abe3837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (118cd25d-974a-4672-9a5f-9af08999b4d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-34867f30-c737-4a4c-b818-50d5bfabaa7a tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:16:35 devstack sudo[113395]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:36 devstack sudo[113403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0 Aug 03 09:16:36 devstack sudo[113403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:36 devstack sudo[113403]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-022d768c-f3f0-4a0e-a28a-2841b7a095a0" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-022d768c-f3f0-4a0e-a28a-2841b7a095a0" released by "delete_volume" :: held 0.728s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:36 devstack sudo[113398]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1073741824" returned: 0 in 0.468s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['a5d2e9ba-d7f3-46df-bbba-522febeda282', 'dff9a62b-91fa-4b80-8f7f-ba07896c50b3', '23b7d7dc-5d2b-4222-b375-8c77ef6d4088', '0b45857a-8e94-42e7-b8e8-38f55bf8d9d1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:36 devstack sudo[113411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:36 devstack sudo[113411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:36 devstack sudo[113413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:36 devstack sudo[113413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:36 devstack sudo[113411]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-50957c04-5492-4414-a87c-ce6b95969bf0-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:36 devstack sudo[113413]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.253s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-50957c04-5492-4414-a87c-ce6b95969bf0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Attempting download of 40fc83d3-e797-469c-be17-39048e0edda4 ((None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}])) to volume 3936eec9-69fe-4ab7-8472-0d720de8591b. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c1777f56-de1f-4e4a-9f12-4a11adfda55d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-022d768c-f3f0-4a0e-a28a-2841b7a095a0-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-50957c04-5492-4414-a87c-ce6b95969bf0" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[866d20d5-11a0-4173-8bbf-352b329c216e]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-50957c04-5492-4414-a87c-ce6b95969bf0" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b30a23d-844c-4176-90a3-6f40b585bc15]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:36 devstack sudo[113417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6 Aug 03 09:16:36 devstack sudo[113417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:36 devstack sudo[113418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 Aug 03 09:16:36 devstack sudo[113418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:37 devstack sudo[113417]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6" returned: 0 in 0.320s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:37 devstack sudo[113418]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:37 devstack sudo[113423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6 Aug 03 09:16:37 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:37 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0 Aug 03 09:16:37 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:37 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-50957c04-5492-4414-a87c-ce6b95969bf0" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-50957c04-5492-4414-a87c-ce6b95969bf0" released by "delete_volume" :: held 0.715s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:37 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6" returned: 1 in 0.435s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_40fc83d3-e797-469c-be17-39048e0edda4_dp8l_sz6' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[83667599-4e43-4db9-92cf-5a1236854966]: (4, 'raw') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['5865c797-cea9-4272-8665-f514c8a1eb0f', 'a693cdb5-fc23-4b2f-9210-cf86285c57c0', 'ff0560c1-f201-4d5a-84a1-1aa7836b0052', 'e005db08-bff5-4ccd-afd5-6e96966260f8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:37 devstack sudo[113434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:37 devstack sudo[113434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:37 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (c8e60b56-87da-40f3-aaef-0fdb36a83edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:37 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cab3d6-7733-4488-85ac-4fab7b150bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7cab3d6-7733-4488-85ac-4fab7b150bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-58107142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3481b0f-e276-45df-8070-78aefe6d6542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=1c714497-3ec2-4c62-98f8-5a32495b2e3c,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:38Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c53e1e-7312-40f5-b11a-dc2e03000a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9c53e1e-7312-40f5-b11a-dc2e03000a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3185f27-3390-4a97-86db-00a3dde100cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3185f27-3390-4a97-86db-00a3dde100cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd3481b0f-e276-45df-8070-78aefe6d6542', 'volume_name': 'volume-d3481b0f-e276-45df-8070-78aefe6d6542', 'volume_size': 1, 'source_volid': '1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8917a97d-5623-4fd1-940b-e1f318e690ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8917a97d-5623-4fd1-940b-e1f318e690ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7ec3c-da4d-453e-980c-ab5382e50817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:37 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Volume d3481b0f-e276-45df-8070-78aefe6d6542: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d3481b0f-e276-45df-8070-78aefe6d6542', 'volume_size': 1, 'source_volid': '1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'source_volstatus': 'available'} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:37 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Cloning volume 1c714497-3ec2-4c62-98f8-5a32495b2e3c to volume d3481b0f-e276-45df-8070-78aefe6d6542 Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot dd708270-3c97-429f-8257-584ddd63586c of volume 1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-8440128c-9056-4a76-8ac2-3ece705f77bc-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-8440128c-9056-4a76-8ac2-3ece705f77bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa2ca54-ec89-431c-bd3f-5a35d0f5c223]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-8440128c-9056-4a76-8ac2-3ece705f77bc" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-8440128c-9056-4a76-8ac2-3ece705f77bc" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:37 devstack sudo[113434]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f20a484-e561-49af-93e5-70d0585da7a0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:38 devstack sudo[113439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:38 devstack sudo[113439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-785040ac-d639-405b-97f3-42e3b96debf4 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-50957c04-5492-4414-a87c-ce6b95969bf0-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:38 devstack sudo[113442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD Aug 03 09:16:38 devstack sudo[113442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc Aug 03 09:16:38 devstack sudo[113443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113439]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.425s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113442]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD" returned: 1 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] 40fc83d3-e797-469c-be17-39048e0edda4 was raw, converting to qcow2 {{(pid=88796) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 09:16:38 devstack sudo[113453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c 1G Aug 03 09:16:38 devstack sudo[113453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:38 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113443]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc Aug 03 09:16:38 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8440128c-9056-4a76-8ac2-3ece705f77bc" returned: 0 in 0.249s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-8440128c-9056-4a76-8ac2-3ece705f77bc" released by "delete_volume" :: held 0.732s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['8568e014-2ecb-4f34-9eb0-e4ae3f4db24f', '69069b23-84d9-44f7-8388-776c9096ec42', '869bc1d1-9d2b-4c53-9376-667aad0ad237', '6466632c-0078-49b6-aba4-de5c553ac592'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:38 devstack sudo[113453]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c 1G" returned: 0 in 0.527s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:38 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:38 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:38 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.567s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_40fc83d3-e797-469c-be17-39048e0edda4_naim8oy5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:38 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 09:16:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:38 devstack sudo[113476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1G Aug 03 09:16:38 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-691a6e1f-6511-4f94-9b55-3516d0ccdd0d-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-691a6e1f-6511-4f94-9b55-3516d0ccdd0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-691a6e1f-6511-4f94-9b55-3516d0ccdd0d" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:39 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-691a6e1f-6511-4f94-9b55-3516d0ccdd0d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleting offline snapshot 691a6e1f-6511-4f94-9b55-3516d0ccdd0d of volume 398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] snapshot_file for this snap is: volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.339s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[39547045-8d2c-493f-91a5-030daf176827]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-15aedd90-e3e9-4faf-8f69-f9b72c81463c tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-8440128c-9056-4a76-8ac2-3ece705f77bc-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:39 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.377s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c is being set with open permissions: ugo+rw Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:39 devstack sudo[113485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:39 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack sudo[113482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d Aug 03 09:16:39 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b 1G" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Downloaded image 40fc83d3-e797-469c-be17-39048e0edda4 ((None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}])) to volume 3936eec9-69fe-4ab7-8472-0d720de8591b successfully. {{(pid=88796) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Temporary image 40fc83d3-e797-469c-be17-39048e0edda4 for user f707fbd9908744f7b51191626725df12 is deleted. {{(pid=88796) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Marking volume 3936eec9-69fe-4ab7-8472-0d720de8591b as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Copying metadata from image 40fc83d3-e797-469c-be17-39048e0edda4 to 3936eec9-69fe-4ab7-8472-0d720de8591b. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Creating volume glance metadata for volume 3936eec9-69fe-4ab7-8472-0d720de8591b backed by image 40fc83d3-e797-469c-be17-39048e0edda4 with: {'image_id': '40fc83d3-e797-469c-be17-39048e0edda4', 'image_name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'checksum': '0819dc68d09cb2f3cd34eee18c5e32c5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88796) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d903a7ba-b460-4e90-8a10-b6b293c6d09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3936eec9-69fe-4ab7-8472-0d720de8591b', 'volume_size': 1, 'image_id': '40fc83d3-e797-469c-be17-39048e0edda4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/40fc83d3-e797-469c-be17-39048e0edda4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-e6050452-06bd-4c7f-9912-45178c83e379', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0819dc68d09cb2f3cd34eee18c5e32c5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3af8e874af2543568360ae5ee7e12568', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3ac122a2238a8f4ac98fd41f459f1ba62d962167a0aeb1b1744374d4ca22a99c71816d69bbdf61852ef0dbcdc8a7b61f9f7d4c58df9e19b4e394fe4239ec9278', 'id': '40fc83d3-e797-469c-be17-39048e0edda4', 'created_at': datetime.datetime(2026, 8, 3, 7, 16, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 7, 16, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/40fc83d3-e797-469c-be17-39048e0edda4/file', 'properties': {}}, 'image_service': }' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58425937-5c5c-4e72-a58b-73763eeaaae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:39 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Volume volume-3936eec9-69fe-4ab7-8472-0d720de8591b (3936eec9-69fe-4ab7-8472-0d720de8591b): created successfully Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58425937-5c5c-4e72-a58b-73763eeaaae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:39 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (66a73268-2cbe-44f1-8e99-35187efccb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.279s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b69f04fd-73d3-423c-b742-a7fa4d790479 tempest-VolumeImageDependencyTests-1527199520 None] Created volume successfully. Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:39 devstack sudo[113492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info Aug 03 09:16:39 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d" returned: 0 in 0.430s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-398ff061-acb3-4c38-a07f-bac69bdc34c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e4f33b-766d-4f3a-9352-4743bbdf8071]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:39 devstack sudo[113495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 Aug 03 09:16:39 devstack sudo[113495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:39 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info is being set with open permissions: ugo+rw Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:39 devstack sudo[113498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info Aug 03 09:16:39 devstack sudo[113498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:40 devstack sudo[113495]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5" returned: 0 in 0.405s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:40 devstack sudo[113503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d Aug 03 09:16:40 devstack sudo[113503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:40 devstack sudo[113498]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.info" returned: 0 in 0.298s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] snapshot: dd708270-3c97-429f-8257-584ddd63586c, volume: d3481b0f-e276-45df-8070-78aefe6d6542, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63d004-96e0-4a7e-9613-e0409a1b48f5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:40 devstack sudo[113506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:40 devstack sudo[113506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:40 devstack sudo[113503]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:40 devstack sudo[113511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d Aug 03 09:16:40 devstack sudo[113511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:40 devstack sudo[113506]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbf0553-aaf3-47cb-9506-2b8c959109ce]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:40 devstack sudo[113511]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5.691a6e1f-6511-4f94-9b55-3516d0ccdd0d" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-691a6e1f-6511-4f94-9b55-3516d0ccdd0d" released by "_delete_snapshot" :: held 1.593s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:40 devstack sudo[113516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:40 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" released by "delete_snapshot" :: held 1.629s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['370f45c6-184c-4ab2-a610-e952b8f1f010', 'f14cebca-eab2-4aa7-9447-87b11254eb9a', '11d3af38-8c1c-45c6-ab6a-18e437d67b89', 'af14b4f7-4343-4e5a-82d8-e6ef827313cf'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Delete snapshot completed successfully. Aug 03 09:16:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-45d61ca3-173a-4143-8db8-ad91f91e2eb3 tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-691a6e1f-6511-4f94-9b55-3516d0ccdd0d-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:41 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.419s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:41 devstack sudo[113523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 Aug 03 09:16:41 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-398ff061-acb3-4c38-a07f-bac69bdc34c5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-398ff061-acb3-4c38-a07f-bac69bdc34c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c639ad05-f994-4c9a-85b9-8bd33fc8369b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:41 devstack sudo[113529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 Aug 03 09:16:41 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:41 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542" returned: 0 in 0.487s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:41 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:16:41 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 is being set with open permissions: ugo+rw Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:41 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 Aug 03 09:16:41 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:41 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:41 devstack sudo[113537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5 Aug 03 09:16:41 devstack sudo[113537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:41 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542" returned: 0 in 0.298s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" released by "_copy_volume_from_snapshot" :: held 1.655s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-dd708270-3c97-429f-8257-584ddd63586c" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-dd708270-3c97-429f-8257-584ddd63586c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot dd708270-3c97-429f-8257-584ddd63586c of volume 1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ce669e-7897-4eb2-8949-4dec8874baad]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:42 devstack sudo[113537]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-398ff061-acb3-4c38-a07f-bac69bdc34c5" returned: 0 in 0.301s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:42 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:42 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-quobyte-398ff061-acb3-4c38-a07f-bac69bdc34c5" released by "delete_volume" :: held 0.763s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Created reservations ['b87d34bf-2795-4fc5-b7da-76c800d49d67', '573ec59f-cd62-407d-bfff-6bae8688a281', '24a17409-6e57-49d9-b1bc-cd59dd48f5f9', 'cf4da47a-d547-43d4-9472-21bb7ea3ce80'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:42 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:42 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:42 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.414s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f276397a-6824-470a-8426-03788d88f51a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:42 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.283s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Deleted volume successfully. Aug 03 09:16:42 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:42 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-31f74306-dbe5-4594-9098-fc5caf851a1d tempest-CreateVolumesFromSnapshotTest-72092298 None] Lock "cinder-398ff061-acb3-4c38-a07f-bac69bdc34c5-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:42 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:42 devstack sudo[113555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:42 devstack sudo[113555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:43 devstack sudo[113555]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:43 devstack sudo[113561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c Aug 03 09:16:43 devstack sudo[113561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:43 devstack sudo[113561]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c.dd708270-3c97-429f-8257-584ddd63586c" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-dd708270-3c97-429f-8257-584ddd63586c" released by "_delete_snapshot" :: held 1.632s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 5.742s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.629s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c7ec3c-da4d-453e-980c-ab5382e50817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3481b0f-e276-45df-8070-78aefe6d6542', 'volume_size': 1, 'source_volid': '1c714497-3ec2-4c62-98f8-5a32495b2e3c', 'source_volstatus': 'available'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3286b0f5-97a4-4e14-80a6-09b7d23e8ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Creating offline snapshot fbc59d08-22b9-402f-96a9-91bfea88fcfd of volume 3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Volume volume-d3481b0f-e276-45df-8070-78aefe6d6542 (d3481b0f-e276-45df-8070-78aefe6d6542): created successfully Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3286b0f5-97a4-4e14-80a6-09b7d23e8ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (c8e60b56-87da-40f3-aaef-0fdb36a83edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d0cb2-8242-4d3e-9ddc-86cff49564f0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-332eaff5-664f-4412-9450-3e20074c67e7 tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:16:43 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:43 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-caab1e19-cccf-45da-92bd-919e477f1c04-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-caab1e19-cccf-45da-92bd-919e477f1c04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot caab1e19-cccf-45da-92bd-919e477f1c04 of volume 3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:44 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.457s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec919e8-2118-4aea-aaf6-32b3c3cb8805]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:44 devstack sudo[113570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd 1G Aug 03 09:16:44 devstack sudo[113570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:44 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:44 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:44 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.455s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3946b4a7-e11e-4105-a300-c768929f6b9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:44 devstack sudo[113570]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd 1G" returned: 0 in 0.497s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3936eec9-69fe-4ab7-8472-0d720de8591b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3c26a2-7d4b-477d-99f6-66b14954f895]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:44 devstack sudo[113581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3936eec9-69fe-4ab7-8472-0d720de8591b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:44 devstack sudo[113581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:44 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:44 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:44 devstack sudo[113581]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3936eec9-69fe-4ab7-8472-0d720de8591b -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.334s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:44 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd is being set with open permissions: ugo+rw Aug 03 09:16:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:44 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:44 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.589s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:45 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.293s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=242,cinder:SELECT=198,cinder:DELETE=19,cinder:INSERT=76 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:45 devstack sudo[113596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info Aug 03 09:16:45 devstack sudo[113596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack sudo[113596]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info is being set with open permissions: ugo+rw Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:45 devstack sudo[113602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info Aug 03 09:16:45 devstack sudo[113602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.459s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:45 devstack sudo[113604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04 Aug 03 09:16:45 devstack sudo[113604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (3e67ba0f-0b72-4dae-8667-ec0c72b758ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffee799-e85f-4f93-8def-f8a10ddc1d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ffee799-e85f-4f93-8def-f8a10ddc1d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846170261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04cf272-b7ca-4ae8-9240-34efe630487b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:46Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd63cf-1cee-4b00-a72e-85b684baa0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd63cf-1cee-4b00-a72e-85b684baa0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75166202-6d5f-4c7f-bf4f-32fd099dcd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75166202-6d5f-4c7f-bf4f-32fd099dcd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04cf272-b7ca-4ae8-9240-34efe630487b', 'volume_name': 'volume-d04cf272-b7ca-4ae8-9240-34efe630487b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b58be46-988a-4ad3-b9c2-443c1d5b0863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:45 devstack sudo[113602]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b58be46-988a-4ad3-b9c2-443c1d5b0863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517196e-904a-4bd8-a22f-6b3095eadc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:45 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume d04cf272-b7ca-4ae8-9240-34efe630487b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04cf272-b7ca-4ae8-9240-34efe630487b', 'volume_size': 1} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.info" returned: 0 in 0.297s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.019s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846170261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04cf272-b7ca-4ae8-9240-34efe630487b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:46Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume d04cf272-b7ca-4ae8-9240-34efe630487b {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:45 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:45 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b 1073741824 Aug 03 09:16:45 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:45 devstack sudo[113604]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d.caab1e19-cccf-45da-92bd-919e477f1c04" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:45 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-70fb1dfa-ab9f-4b6f-be5a-f0c7d27e6756 tempest-VolumeImageDependencyTests-1527199520 None] Create snapshot completed successfully Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-caab1e19-cccf-45da-92bd-919e477f1c04" released by "_delete_snapshot" :: held 1.965s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" released by "delete_snapshot" :: held 1.994s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Created reservations ['9ad84504-93f8-4c9b-9fa6-197ecc7e6ce9', '725b7ddb-9bef-47e6-9dbf-e8749187a81b', '8657e55a-76e7-4a25-abf9-3df24a333a02', '73365c72-2680-422a-b6e5-3ed4846a94ba'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Delete snapshot completed successfully. Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3130eaf3-834c-4ceb-9215-697c49ceb152 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-caab1e19-cccf-45da-92bd-919e477f1c04-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:46 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b 1073741824" returned: 0 in 0.549s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:46 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b Aug 03 09:16:46 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:46 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e517196e-904a-4bd8-a22f-6b3095eadc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04cf272-b7ca-4ae8-9240-34efe630487b', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062711a0-15fe-42ec-bc92-defb9ee13a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-d04cf272-b7ca-4ae8-9240-34efe630487b (d04cf272-b7ca-4ae8-9240-34efe630487b): created successfully Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062711a0-15fe-42ec-bc92-defb9ee13a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (3e67ba0f-0b72-4dae-8667-ec0c72b758ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-42cada84-6d53-4580-ad2b-f49ebf623807 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (959a5808-febf-43b2-a8b2-f3db93337c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480f580-0007-4cc5-8bbf-7099c064e3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b480f580-0007-4cc5-8bbf-7099c064e3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume2-for-test-e6050452-06bd-4c7f-9912-45178c83e379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3af8e874af2543568360ae5ee7e12568',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fbc59d08-22b9-402f-96a9-91bfea88fcfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:47Z,use_quota=True,user_id='f707fbd9908744f7b51191626725df12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62eae9f-c0b3-4739-9305-b668bd5f188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d62eae9f-c0b3-4739-9305-b668bd5f188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916491c8-bfa9-4caf-ba10-f48b0ecfab72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (916491c8-bfa9-4caf-ba10-f48b0ecfab72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9', 'volume_name': 'volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9', 'volume_size': 1, 'snapshot_id': 'fbc59d08-22b9-402f-96a9-91bfea88fcfd'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658c359-4ad2-4f28-a862-110803ac14de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e658c359-4ad2-4f28-a862-110803ac14de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb4f9f7-6d7e-47ef-be68-f40c0cf537d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:46 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Volume aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9', 'volume_size': 1, 'snapshot_id': 'fbc59d08-22b9-402f-96a9-91bfea88fcfd'} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Creating volume aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 from snapshot fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] snapshot: fbc59d08-22b9-402f-96a9-91bfea88fcfd, volume: aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50feb1e-83bc-40cd-beea-1db30737efb5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:47 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:47 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-9b8f7944-a93a-4945-969c-144c946aea74-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-9b8f7944-a93a-4945-969c-144c946aea74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot 9b8f7944-a93a-4945-969c-144c946aea74 of volume 7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e90b17-1cbd-4305-9c28-31a93739b9b7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:47 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:47 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.383s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3936eec9-69fe-4ab7-8472-0d720de8591b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:47 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5f76e8-0695-425c-ada5-16724d55f39e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:47 devstack sudo[113660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:47 devstack sudo[113660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:47 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.393s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7eaf69a7-f891-4890-b140-dc713f08e2b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b748a4-40fc-48ea-be87-a370045b9485]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:47 devstack sudo[113660]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.411s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:16:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:47 devstack sudo[113665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:47 devstack sudo[113665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:47 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 Aug 03 09:16:47 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:48 devstack sudo[113665]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:48 devstack sudo[113679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:48 devstack sudo[113679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (12d574fa-26da-4f45-ad78-8d0ac80b3cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd66547-1fb1-48bc-822c-a1be2577fad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd66547-1fb1-48bc-822c-a1be2577fad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328271039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51ba3-638d-46a8-8887-f4c6c1112498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:48Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf053ad-e913-4116-98c4-da368c182a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf053ad-e913-4116-98c4-da368c182a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15df43a-af43-4ce5-8214-04c4e3ba212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15df43a-af43-4ce5-8214-04c4e3ba212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec51ba3-638d-46a8-8887-f4c6c1112498', 'volume_name': 'volume-8ec51ba3-638d-46a8-8887-f4c6c1112498', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a2c82a-8af0-4950-bb2e-13181ff6a980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a2c82a-8af0-4950-bb2e-13181ff6a980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d12fe1-098e-42eb-bcb6-22d615c52c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume 8ec51ba3-638d-46a8-8887-f4c6c1112498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec51ba3-638d-46a8-8887-f4c6c1112498', 'volume_size': 1} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:48 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" returned: 0 in 0.667s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:16:48 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:16:48 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 is being set with open permissions: ugo+rw Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:48 devstack sudo[113683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 Aug 03 09:16:48 devstack sudo[113683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:48 devstack sudo[113679]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:48 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74 Aug 03 09:16:48 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (fb366ff7-0910-46de-a4c8-f77ca2eed32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:48 devstack sudo[113683]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1357366-76be-451c-ab8f-4d6789a3d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" returned: 0 in 0.336s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" released by "_copy_volume_from_snapshot" :: held 1.890s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1357366-76be-451c-ab8f-4d6789a3d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829214559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333b35d0-2729-4ba8-b938-8d3c34ae06cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:49Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4cf49-1613-4ce4-8d69-5898578450ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f4cf49-1613-4ce4-8d69-5898578450ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e925c90a-7010-4e20-99cc-2e21eb7ae170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e925c90a-7010-4e20-99cc-2e21eb7ae170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '333b35d0-2729-4ba8-b938-8d3c34ae06cd', 'volume_name': 'volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e098cd94-71ec-4e70-8f6e-0415c18d3f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e098cd94-71ec-4e70-8f6e-0415c18d3f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f11a49-e623-4a7c-829a-7f5c35441c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume 333b35d0-2729-4ba8-b938-8d3c34ae06cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd', 'volume_size': 1} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" released by "_create_volume_from_snapshot" :: held 2.009s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 2.026s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-328271039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51ba3-638d-46a8-8887-f4c6c1112498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:48Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume 8ec51ba3-638d-46a8-8887-f4c6c1112498 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:49 devstack sudo[113692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 1073741824 Aug 03 09:16:49 devstack sudo[113692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.volume_utils [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Marking volume aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 as bootable. {{(pid=88796) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Copying metadata from snapshot fbc59d08-22b9-402f-96a9-91bfea88fcfd to aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9. {{(pid=88796) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:429}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb4f9f7-6d7e-47ef-be68-f40c0cf537d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9', 'volume_size': 1, 'snapshot_id': 'fbc59d08-22b9-402f-96a9-91bfea88fcfd'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba854ec-7373-4dd4-9665-27652ba82eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6.9b8f7944-a93a-4945-969c-144c946aea74" returned: 0 in 0.436s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Volume volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 (aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9): created successfully Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba854ec-7373-4dd4-9665-27652ba82eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Flow 'volume_create_manager' (959a5808-febf-43b2-a8b2-f3db93337c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-9b8f7944-a93a-4945-969c-144c946aea74" released by "_delete_snapshot" :: held 1.935s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2eb363dc-c22d-46df-998b-5dd4e5d274af tempest-VolumeImageDependencyTests-1527199520 None] Created volume successfully. Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" released by "delete_snapshot" :: held 1.984s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (e0a9991f-e6d8-47a1-bdc3-460b4845b2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7cba33-15dd-47c3-8d46-f310be79503d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd7cba33-15dd-47c3-8d46-f310be79503d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452789760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9779fe62-21ea-44fe-9599-515ffe7d5597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:49Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ab4c3-5833-4ba7-87d8-2c6dd4ab5200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242ab4c3-5833-4ba7-87d8-2c6dd4ab5200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfb6173-b1dd-4e5c-843f-2313d75564a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dfb6173-b1dd-4e5c-843f-2313d75564a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9779fe62-21ea-44fe-9599-515ffe7d5597', 'volume_name': 'volume-9779fe62-21ea-44fe-9599-515ffe7d5597', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a4cfc-4ee2-4133-8847-7789a86a3146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (527a4cfc-4ee2-4133-8847-7789a86a3146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a12d73-fd2f-4582-9c4a-441aad66395b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume 9779fe62-21ea-44fe-9599-515ffe7d5597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9779fe62-21ea-44fe-9599-515ffe7d5597', 'volume_size': 1} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Created reservations ['c214afec-a08a-46f0-9a9b-0894185b23e8', 'f834d7b4-7984-4b10-8c03-c08dcecc5ba1', '0682610c-cfc9-4237-b525-37efaa663e8e', '2e06d73d-a211-4b7b-a21e-9bdb8e8a7b72'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Delete snapshot completed successfully. Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c27b1cdb-22cb-41e2-9348-02ff839bb7d3 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-9b8f7944-a93a-4945-969c-144c946aea74-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:49 devstack sudo[113692]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 1073741824" returned: 0 in 0.602s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:49 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 Aug 03 09:16:49 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (cade86b6-601a-4e21-88e4-367910d94e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c8c1a2-0eb0-4576-a3c4-8cdb2cbe415e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c8c1a2-0eb0-4576-a3c4-8cdb2cbe415e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-25416456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd690451-9fe0-4dd8-8eb4-9be3da3f7160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:50Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da7bb96-fa09-4234-92ca-e13af3cacdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da7bb96-fa09-4234-92ca-e13af3cacdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068569eb-6a95-4621-901e-004498140e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068569eb-6a95-4621-901e-004498140e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd690451-9fe0-4dd8-8eb4-9be3da3f7160', 'volume_name': 'volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a139aaa5-28d1-449b-8f2d-3f8d3888820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a139aaa5-28d1-449b-8f2d-3f8d3888820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d1e582-6a01-4088-bb9e-8e795f93f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume fd690451-9fe0-4dd8-8eb4-9be3da3f7160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160', 'volume_size': 1} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:49 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-829214559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333b35d0-2729-4ba8-b938-8d3c34ae06cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:49Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume 333b35d0-2729-4ba8-b938-8d3c34ae06cd {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:49 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d12fe1-098e-42eb-bcb6-22d615c52c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec51ba3-638d-46a8-8887-f4c6c1112498', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack sudo[113702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd 1073741824 Aug 03 09:16:50 devstack sudo[113702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb31532-5f69-400d-89c0-374a47ff4bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 (8ec51ba3-638d-46a8-8887-f4c6c1112498): created successfully Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb31532-5f69-400d-89c0-374a47ff4bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (12d574fa-26da-4f45-ad78-8d0ac80b3cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2f6b2edc-be48-4dc8-a077-c7b60a111f60 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (606fb402-d8b4-4f47-9052-6a03d9ec9c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcd94b9-3cd1-4b14-b399-b026231f9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-fbc59d08-22b9-402f-96a9-91bfea88fcfd-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcd94b9-3cd1-4b14-b399-b026231f9510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699215651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0d4a8d-c045-424b-8f8a-962e6d98e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:50Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67304ead-ddb2-4669-a7c6-25b9425df3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67304ead-ddb2-4669-a7c6-25b9425df3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad0f6ee-ac9e-42c6-b953-4da537cf968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad0f6ee-ac9e-42c6-b953-4da537cf968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0d4a8d-c045-424b-8f8a-962e6d98e243', 'volume_name': 'volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056a95ac-cf6d-4cdf-87d5-0132fa0d800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (056a95ac-cf6d-4cdf-87d5-0132fa0d800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ae9987-682e-4b79-85cf-c4b5e473029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:50 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume ac0d4a8d-c045-424b-8f8a-962e6d98e243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243', 'volume_size': 1} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-fbc59d08-22b9-402f-96a9-91bfea88fcfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Deleting offline snapshot fbc59d08-22b9-402f-96a9-91bfea88fcfd of volume 3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] snapshot_file for this snap is: volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[876242a3-259f-4583-9571-be4b9c5ca86b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack sudo[113707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:50 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-1c714497-3ec2-4c62-98f8-5a32495b2e3c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "cinder-1c714497-3ec2-4c62-98f8-5a32495b2e3c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:50 devstack sudo[113702]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd 1073741824" returned: 0 in 0.581s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e87dded-c874-49bb-ade0-c2fc392dabba]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd Aug 03 09:16:50 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.403s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3936eec9-69fe-4ab7-8472-0d720de8591b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cec56f4-3556-4905-82bf-07e45582fb06]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack sudo[113711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:50 devstack sudo[113711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:50 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452789760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9779fe62-21ea-44fe-9599-515ffe7d5597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:49Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume 9779fe62-21ea-44fe-9599-515ffe7d5597 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:50 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:50 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 1073741824 Aug 03 09:16:50 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33f11a49-e623-4a7c-829a-7f5c35441c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2fb7cf-eb34-46da-9a03-8cce15e0cf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd (333b35d0-2729-4ba8-b938-8d3c34ae06cd): created successfully Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2fb7cf-eb34-46da-9a03-8cce15e0cf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (fb366ff7-0910-46de-a4c8-f77ca2eed32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-791ea93c-63ec-4a90-8f14-69ee3a22485a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:51 devstack sudo[113711]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.404s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c Aug 03 09:16:51 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.432s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:51 devstack sudo[113730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1c714497-3ec2-4c62-98f8-5a32495b2e3c" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-1c714497-3ec2-4c62-98f8-5a32495b2e3c" released by "delete_volume" :: held 0.788s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Created reservations ['290bacbd-857b-46ab-a752-7007194c94b4', '84c1f73e-bc63-4a5a-8d02-f2ef577b1cad', '1d81d229-6ed9-46c0-9564-52a1996ba7f5', '6f0b83d4-f582-4eab-b64d-d47c853d51b8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:51 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 1073741824" returned: 0 in 0.618s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack sudo[113740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:51 devstack sudo[113740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113730]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.442s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 Aug 03 09:16:51 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd Aug 03 09:16:51 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-3946b4a7-e11e-4105-a300-c768929f6b9d-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-3946b4a7-e11e-4105-a300-c768929f6b9d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:51 devstack sudo[113740]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1db38d-9f10-420d-974d-96569dcbee76]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597" returned: 0 in 0.304s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-25416456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd690451-9fe0-4dd8-8eb4-9be3da3f7160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:50Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume fd690451-9fe0-4dd8-8eb4-9be3da3f7160 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:51 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:51 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a12d73-fd2f-4582-9c4a-441aad66395b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9779fe62-21ea-44fe-9599-515ffe7d5597', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:51 devstack sudo[113750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 1073741824 Aug 03 09:16:51 devstack sudo[113750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeaf722-b642-43d6-819c-1ff3c24793ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b.fbc59d08-22b9-402f-96a9-91bfea88fcfd" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9c6ccf10-7d82-450c-b88e-cc3f16b23dcf tempest-VolumeDependencyTests-878745567 None] Lock "cinder-1c714497-3ec2-4c62-98f8-5a32495b2e3c-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-9779fe62-21ea-44fe-9599-515ffe7d5597 (9779fe62-21ea-44fe-9599-515ffe7d5597): created successfully Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abeaf722-b642-43d6-819c-1ff3c24793ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (e0a9991f-e6d8-47a1-bdc3-460b4845b2c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:52 devstack sudo[113749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:52 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-bdf5371b-9f05-4ded-8b2e-8b0084a24589 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-fbc59d08-22b9-402f-96a9-91bfea88fcfd" released by "_delete_snapshot" :: held 1.767s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" released by "delete_snapshot" :: held 1.797s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['b87bbc53-20a3-426a-8301-2ea2be96c050', '5a4f580b-7321-4b45-a1f9-8d9390797217', 'd9891031-06fa-4dc8-a637-8e5f5ddaaff6', 'f3a331af-ec4e-4216-8555-53545cdc9d54'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Delete snapshot completed successfully. Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-89877eca-f574-46a8-a8d5-3bd87808209e tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-fbc59d08-22b9-402f-96a9-91bfea88fcfd-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:52 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:52 devstack sudo[113760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d Aug 03 09:16:52 devstack sudo[113760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:52 devstack sudo[113750]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[50011df7-69d9-4cfe-9595-aad7ad2d1604]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 1073741824" returned: 0 in 0.584s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:52 devstack sudo[113764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 Aug 03 09:16:52 devstack sudo[113764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack sudo[113760]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3946b4a7-e11e-4105-a300-c768929f6b9d" returned: 0 in 0.308s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-3946b4a7-e11e-4105-a300-c768929f6b9d" released by "delete_volume" :: held 0.793s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:52 devstack sudo[113762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 Aug 03 09:16:52 devstack sudo[113762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Created reservations ['481b6f76-959f-41df-af69-0b0416c3518e', '5eda14f4-e123-4f34-955d-bd83da9a1bd8', '22322db4-bde9-4d1e-af1b-36b54456fa54', 'b758c08b-51d1-4424-b5e6-69529b9a6bc3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:52 devstack sudo[113774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:52 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack sudo[113764]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" returned: 0 in 0.282s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.625s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-699215651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0d4a8d-c045-424b-8f8a-962e6d98e243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821f1be344f348248239cf337a3087c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:50Z,use_quota=True,user_id='59d9a2094d324ab0b78fbc4fd3df0c61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Creating volume ac0d4a8d-c045-424b-8f8a-962e6d98e243 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:52 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48d1e582-6a01-4088-bb9e-8e795f93f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e190ad12-372c-4a74-ad9b-16deb91c28c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:52 devstack sudo[113776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 1073741824 Aug 03 09:16:52 devstack sudo[113776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 (fd690451-9fe0-4dd8-8eb4-9be3da3f7160): created successfully Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e190ad12-372c-4a74-ad9b-16deb91c28c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (cade86b6-601a-4e21-88e4-367910d94e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e57606bd-39f5-456b-b070-a41ec65d592a tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-7eaf69a7-f891-4890-b140-dc713f08e2b6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:53 devstack sudo[113762]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" returned: 0 in 0.517s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-7eaf69a7-f891-4890-b140-dc713f08e2b6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:53 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9 Aug 03 09:16:53 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" acquired by "delete_volume" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2462369e-9d4f-4203-80e3-32d90f64aba5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:53 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-435d2aa4-0772-46a3-8165-346fc35edf05 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-3946b4a7-e11e-4105-a300-c768929f6b9d-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:53 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:53 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:53 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" returned: 0 in 0.337s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack sudo[113776]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9" released by "delete_volume" :: held 0.907s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 1073741824" returned: 0 in 0.529s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:53 devstack sudo[113791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 Aug 03 09:16:53 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['2829db8b-942c-4b97-9963-528dc3f7750b', '4770eab8-5831-481f-bc59-ce2eea1c2faf', '682c8309-3652-4429-8224-b63a2db33b0f', 'cb131ccc-609e-495b-b863-210b873f16a3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:53 devstack sudo[113796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:53 devstack sudo[113796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:53 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.492s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:53 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6 Aug 03 09:16:53 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:53 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243" returned: 0 in 0.384s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-3936eec9-69fe-4ab7-8472-0d720de8591b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ae9987-682e-4b79-85cf-c4b5e473029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a3ea36-35d6-46ec-8ccb-7791939f5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:53 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Volume volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 (ac0d4a8d-c045-424b-8f8a-962e6d98e243): created successfully Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a3ea36-35d6-46ec-8ccb-7791939f5e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Flow 'volume_create_manager' (606fb402-d8b4-4f47-9052-6a03d9ec9c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-3936eec9-69fe-4ab7-8472-0d720de8591b-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-35ff548b-0576-4043-97ec-57920e1fa0b7 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created volume successfully. Aug 03 09:16:53 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7eaf69a7-f891-4890-b140-dc713f08e2b6" returned: 0 in 0.291s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:53 devstack sudo[113796]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.364s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Deleted volume successfully. Aug 03 09:16:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-7eaf69a7-f891-4890-b140-dc713f08e2b6" released by "delete_volume" :: held 0.861s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1e9533-61e1-4610-bb7c-4eb3217e0031]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7f355d90-90d8-41e6-b9ba-64e5c1fa760d tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-aacf25d6-3152-4d8e-8d48-e3f9c81cfcb9-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Created reservations ['70920c17-8bc4-452d-b680-2bfb6ced16fc', 'd2eb3a99-5b7f-4312-9c2c-639c85ae3cff', '39fdc898-d402-422e-aacb-476c1a4b2ca9', '9d98af75-a485-4c14-a7aa-00846a7ed4a6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:54 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:54 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:54 devstack sudo[113805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:54 devstack sudo[113805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:54 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.391s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:54 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b Aug 03 09:16:54 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:54 devstack sudo[113805]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1c1da391-7407-4cf9-8040-072979b2839a tempest-VolumeDependencyTests-878745567 None] Lock "cinder-7eaf69a7-f891-4890-b140-dc713f08e2b6-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:54 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-3936eec9-69fe-4ab7-8472-0d720de8591b" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-ac0d4a8d-c045-424b-8f8a-962e6d98e243-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-3936eec9-69fe-4ab7-8472-0d720de8591b" released by "delete_volume" :: held 0.737s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-ac0d4a8d-c045-424b-8f8a-962e6d98e243-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-ac0d4a8d-c045-424b-8f8a-962e6d98e243" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-ac0d4a8d-c045-424b-8f8a-962e6d98e243" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['150a7bae-e7cb-463d-9161-39adc69b8dc7', 'e06b4756-3b68-4ed6-ab64-8c5a6e3c89ac', '332da782-462f-4716-bbae-ed532bb22630', '0ef27787-5bf8-4077-ac8c-c05308b914de'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0dd7a5-4771-4a58-bdbe-25b9656dab64]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:54 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:54 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:54 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 Aug 03 09:16:54 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Deleted volume successfully. Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-285213f5-ce25-4a6f-b6f3-087abc6a6bab tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-3936eec9-69fe-4ab7-8472-0d720de8591b-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-d3481b0f-e276-45df-8070-78aefe6d6542-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:55 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243" returned: 0 in 0.462s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:55 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243 Aug 03 09:16:55 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-d3481b0f-e276-45df-8070-78aefe6d6542-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f4cfd-3296-463d-8412-3a460bb7bae1]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0695109b-72a7-4d8c-8806-b1704ee23452]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack sudo[113824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb Aug 03 09:16:55 devstack sudo[113825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 Aug 03 09:16:55 devstack sudo[113825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack sudo[113824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-ac0d4a8d-c045-424b-8f8a-962e6d98e243" returned: 0 in 0.334s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-ac0d4a8d-c045-424b-8f8a-962e6d98e243" released by "delete_volume" :: held 0.847s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['2dd3c194-bb75-4a4f-8198-16d9c39512c4', 'bd4539ad-5916-4227-8de2-c9aad85119eb', 'ce858f5e-d993-4152-8070-07860239fae2', '3b247549-0018-42d8-80e8-9c8cfb654f47'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:55 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack sudo[113824]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" returned: 0 in 0.446s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack sudo[113825]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542" returned: 0 in 0.448s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:55 devstack sudo[113837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb Aug 03 09:16:55 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-fd690451-9fe0-4dd8-8eb4-9be3da3f7160-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:55 devstack sudo[113838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542 Aug 03 09:16:55 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-fd690451-9fe0-4dd8-8eb4-9be3da3f7160-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce79480-80bf-4292-8345-65dddc089dc0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:56 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" returned: 0 in 0.306s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:16:56 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-quobyte-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb" released by "delete_volume" :: held 0.810s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:56 devstack sudo[113841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 Aug 03 09:16:56 devstack sudo[113841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d3481b0f-e276-45df-8070-78aefe6d6542" returned: 0 in 0.317s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-d3481b0f-e276-45df-8070-78aefe6d6542" released by "delete_volume" :: held 0.816s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51dc6926-edf1-4bea-88fd-2196b9130b8f tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-ac0d4a8d-c045-424b-8f8a-962e6d98e243-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Created reservations ['26d9f698-ec88-42c1-8763-2c5a03e66b57', '19bec7a8-5045-4432-8e57-0081fefcc845', '1c16d4df-c893-4b42-b499-91f270680f03', '2bdcf69f-2b4c-4d69-a9e8-348a05b4ca37'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Created reservations ['47f54c0c-f694-4eb2-a0d9-10689fac9113', '08a2e889-c7ff-4f63-9269-688aab6ee5cf', '1840844f-84e4-48cb-bd8f-da7c08c3eb5d', 'b3ccd4f3-9d35-48ad-8fb7-caa883057b4d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:56 devstack sudo[113846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:56 devstack sudo[113846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:56 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:56 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:56 devstack sudo[113841]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:56 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160 Aug 03 09:16:56 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:56 devstack sudo[113846]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.314s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Deleted volume successfully. Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7163e79d-bf2a-4f7c-9c27-4c598faa31de tempest-VolumeImageDependencyTests-1527199520 None] Lock "cinder-cc5dfda1-c03b-4f70-b8d2-6612274cd1fb-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:56 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.480s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:16:56 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" returned: 0 in 0.361s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0d0dc8d5-8bff-4b35-906a-07b2ecf1d677 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-d3481b0f-e276-45df-8070-78aefe6d6542-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-fd690451-9fe0-4dd8-8eb4-9be3da3f7160" released by "delete_volume" :: held 0.932s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['665bc597-5ad0-40bf-a4a6-077430793976', '3098b003-62dc-493a-9467-8e7395e9167d', '64ebf4de-e9ad-4c5c-baab-adc4ab9e81e8', 'b72fba5d-e204-4a2c-a65d-c9556abde854'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:57 devstack sudo[113858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:57 devstack sudo[113858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (7f6aecb8-c6d5-40d3-b7ea-dbb0c5ac1096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1c611f-7c5f-46e4-868b-986c16e4097a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c1c611f-7c5f-46e4-868b-986c16e4097a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1989482200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018f8d9f-ba6f-4cc1-ae63-2d173280c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:57Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f236d55e-526d-42a9-9c52-4a1361a0f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f236d55e-526d-42a9-9c52-4a1361a0f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc94100-f250-4a12-a5f2-b61530542707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc94100-f250-4a12-a5f2-b61530542707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '018f8d9f-ba6f-4cc1-ae63-2d173280c7c5', 'volume_name': 'volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc1eb76-5e6f-4678-8033-b7d5fee35edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc1eb76-5e6f-4678-8033-b7d5fee35edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba8d24c-3ed8-4804-b5fe-a3629de4410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:57 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Volume 018f8d9f-ba6f-4cc1-ae63-2d173280c7c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5', 'volume_size': 1} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1989482200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=018f8d9f-ba6f-4cc1-ae63-2d173280c7c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:16:57Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Creating volume 018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:16:57 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:57 devstack sudo[113860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 1073741824 Aug 03 09:16:57 devstack sudo[113860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:57 devstack sudo[113858]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.302s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebc6d15b-5071-4c04-8a8e-38a2deb4b568 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-fd690451-9fe0-4dd8-8eb4-9be3da3f7160-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:57 devstack sudo[113860]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 1073741824" returned: 0 in 0.536s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:57 devstack sudo[113867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:16:57 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:58 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba8d24c-3ed8-4804-b5fe-a3629de4410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a6783e-a120-4fb0-955d-1ec03a966773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:16:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Volume volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 (018f8d9f-ba6f-4cc1-ae63-2d173280c7c5): created successfully Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a6783e-a120-4fb0-955d-1ec03a966773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (7f6aecb8-c6d5-40d3-b7ea-dbb0c5ac1096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:16:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d2659915-7b35-43b2-9e39-03ebdbac637b tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-9779fe62-21ea-44fe-9599-515ffe7d5597-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-9779fe62-21ea-44fe-9599-515ffe7d5597-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-9779fe62-21ea-44fe-9599-515ffe7d5597" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-9779fe62-21ea-44fe-9599-515ffe7d5597" acquired by "delete_volume" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8be81f9-361c-446f-bf5f-9526f9a2f243]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:58 devstack sudo[113871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 Aug 03 09:16:58 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:58 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:58 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597 Aug 03 09:16:58 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:59 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-9779fe62-21ea-44fe-9599-515ffe7d5597" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-9779fe62-21ea-44fe-9599-515ffe7d5597" released by "delete_volume" :: held 0.687s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['bba1ea75-9ca9-4fa3-9de5-bcb11695267e', '79db62a1-a139-455e-a1c9-f8f9b389a1c5', '71d0237f-2e3f-4a22-be83-f967af735241', 'dbcc0888-70ef-440b-992c-4e3083de48b4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:59 devstack sudo[113880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:16:59 devstack sudo[113880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:59 devstack sudo[113880]: pam_unix(sudo:session): session closed for user root Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.296s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:16:59 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0be330b9-dd4b-4231-9b68-4a7d3f737288 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-9779fe62-21ea-44fe-9599-515ffe7d5597-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot ba2952a9-b563-42f6-a614-79887ab03202 of volume 018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[86527463-c40c-4439-858d-e79e9d8e9f04]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-333b35d0-2729-4ba8-b938-8d3c34ae06cd-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-333b35d0-2729-4ba8-b938-8d3c34ae06cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-333b35d0-2729-4ba8-b938-8d3c34ae06cd" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-333b35d0-2729-4ba8-b938-8d3c34ae06cd" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7326a259-0590-4128-b8d9-695a5af451cb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:16:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:16:59 devstack sudo[113883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:16:59 devstack sudo[113883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:16:59 devstack sudo[113885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd Aug 03 09:16:59 devstack sudo[113885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack sudo[113883]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.431s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack sudo[113890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 1G Aug 03 09:17:00 devstack sudo[113890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Flow 'volume_create_manager' (b488c93f-443c-4f12-a9e0-4a21a1ce6a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3058d7-084c-4d15-b51a-c26e1b93da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3058d7-084c-4d15-b51a-c26e1b93da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e49efd4-812a-4aa1-ae0b-04e743b2ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741cd3457c94d60a7093122fc8853f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:00Z,use_quota=True,user_id='35bc234647184b918e11ff6f274bc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:00 devstack sudo[113885]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199f4df-2bea-4fbf-aefb-8bb759f01aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4199f4df-2bea-4fbf-aefb-8bb759f01aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d5676e-7dec-40e8-9fb0-63474cf12495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d5676e-7dec-40e8-9fb0-63474cf12495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e49efd4-812a-4aa1-ae0b-04e743b2ae98', 'volume_name': 'volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b6c390-c1e7-4868-948a-e04eee20e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b6c390-c1e7-4868-948a-e04eee20e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6399b90a-5f4c-49d3-b1b3-ca836ca72665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:00 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Volume 1e49efd4-812a-4aa1-ae0b-04e743b2ae98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98', 'volume_size': 1} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd" returned: 0 in 0.465s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd Aug 03 09:17:00 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack sudo[113890]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 1G" returned: 0 in 0.450s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-333b35d0-2729-4ba8-b938-8d3c34ae06cd" returned: 0 in 0.283s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:00 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-333b35d0-2729-4ba8-b938-8d3c34ae06cd" released by "delete_volume" :: held 0.802s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['21822aff-2394-4490-a5f8-c9d44f2774d7', '08b48bc3-c882-4dc8-a37c-3a909ccedb0e', 'a9b45ba0-2dbf-433c-af7a-0a43a08135d5', '2e340d3a-945c-4d56-a20e-1ef9706704e7'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack sudo[113904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:00 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-8ec51ba3-638d-46a8-8887-f4c6c1112498-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.331s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 is being set with open permissions: ugo+rw Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-8ec51ba3-638d-46a8-8887-f4c6c1112498-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:00 devstack sudo[113911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:00 devstack sudo[113911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-8ec51ba3-638d-46a8-8887-f4c6c1112498" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-8ec51ba3-638d-46a8-8887-f4c6c1112498" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:00 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b1fd00-7c85-45ae-af6d-59453b5da585]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9a84ca65-f7a3-42aa-98d5-65264d2cd46d tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-333b35d0-2729-4ba8-b938-8d3c34ae06cd-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:01 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 Aug 03 09:17:01 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:01 devstack sudo[113911]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:01 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info Aug 03 09:17:01 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:01 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498" returned: 0 in 0.400s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:01 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498 Aug 03 09:17:01 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:01 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:01 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info is being set with open permissions: ugo+rw Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:01 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info Aug 03 09:17:01 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:01 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8ec51ba3-638d-46a8-8887-f4c6c1112498" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-8ec51ba3-638d-46a8-8887-f4c6c1112498" released by "delete_volume" :: held 0.707s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:01 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.info" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.103s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.456s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e49efd4-812a-4aa1-ae0b-04e743b2ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741cd3457c94d60a7093122fc8853f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:00Z,use_quota=True,user_id='35bc234647184b918e11ff6f274bc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Creating volume 1e49efd4-812a-4aa1-ae0b-04e743b2ae98 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:01 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:01 devstack sudo[113933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 1073741824 Aug 03 09:17:01 devstack sudo[113933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-756b0853-b35d-49fe-b04c-a7d5f0c0acdf tempest-VolumeDependencyTests-878745567 None] Create snapshot completed successfully Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['e4d77385-2ea7-4d45-98e3-783cd0743500', '43536b52-4740-452f-935d-f3363633cda6', '745bd8fa-4da5-4e9e-b196-b587b19ce556', 'c5672178-ab0b-49db-b1a8-4816aa3362f1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:01 devstack sudo[113935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:01 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-d04cf272-b7ca-4ae8-9240-34efe630487b-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-d04cf272-b7ca-4ae8-9240-34efe630487b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:02 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.285s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "cinder-quobyte-d04cf272-b7ca-4ae8-9240-34efe630487b" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-d04cf272-b7ca-4ae8-9240-34efe630487b" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-54a934db-9452-4c13-8d1f-0c432e5b09d0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-8ec51ba3-638d-46a8-8887-f4c6c1112498-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d98228-651a-411b-8922-dd9859635f2e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:02 devstack sudo[113933]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 1073741824" returned: 0 in 0.537s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:02 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b Aug 03 09:17:02 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:02 devstack sudo[113944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 Aug 03 09:17:02 devstack sudo[113944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:02 devstack sudo[113944]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:02 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6399b90a-5f4c-49d3-b1b3-ca836ca72665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d401bae-76e0-428f-95ae-9b60c45de51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b" returned: 0 in 0.365s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:02 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Volume volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 (1e49efd4-812a-4aa1-ae0b-04e743b2ae98): created successfully Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d401bae-76e0-428f-95ae-9b60c45de51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:02 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b Aug 03 09:17:02 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Flow 'volume_create_manager' (b488c93f-443c-4f12-a9e0-4a21a1ce6a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-44a95659-6d9b-436e-84b8-8fb1c5ecf9ab tempest-CinderUnicodeTest-1649928661 None] Created volume successfully. Aug 03 09:17:02 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-d04cf272-b7ca-4ae8-9240-34efe630487b" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-quobyte-d04cf272-b7ca-4ae8-9240-34efe630487b" released by "delete_volume" :: held 0.671s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Created reservations ['a3d2da72-6fa8-41b6-871f-31f698c30653', 'e6c6f022-5674-4430-971b-a414bdc4c5be', '756e2cf0-e7d0-456f-9fca-d37610524f6a', 'cd430771-5b1a-4727-afb2-b21dac76df01'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:03 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:03 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:03 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:03 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Deleted volume successfully. Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d45e0c58-ec85-41ed-9ca1-580aef6771b0 tempest-CreateVolumesFromSourceVolumeTest-810581101 None] Lock "cinder-d04cf272-b7ca-4ae8-9240-34efe630487b-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (226baa2c-4cfc-46ec-99f6-aefea221d282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beb1ce4-df42-4b9b-9d6d-c04fe99a353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3beb1ce4-df42-4b9b-9d6d-c04fe99a353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1738485175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efccbe7d-a803-4a3b-8190-49d822e06d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba2952a9-b563-42f6-a614-79887ab03202,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:03Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cce0bc7-31ad-483f-801d-6d23f3671ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cce0bc7-31ad-483f-801d-6d23f3671ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699743f9-67dc-4cbe-af81-a57fffa6d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699743f9-67dc-4cbe-af81-a57fffa6d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efccbe7d-a803-4a3b-8190-49d822e06d1c', 'volume_name': 'volume-efccbe7d-a803-4a3b-8190-49d822e06d1c', 'volume_size': 1, 'snapshot_id': 'ba2952a9-b563-42f6-a614-79887ab03202'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4390665-e698-4d48-a2d5-b532f093188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4390665-e698-4d48-a2d5-b532f093188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb463bc-aedf-458a-9ad1-6711b559437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Volume efccbe7d-a803-4a3b-8190-49d822e06d1c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efccbe7d-a803-4a3b-8190-49d822e06d1c', 'volume_size': 1, 'snapshot_id': 'ba2952a9-b563-42f6-a614-79887ab03202'} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202-efccbe7d-a803-4a3b-8190-49d822e06d1c" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202-efccbe7d-a803-4a3b-8190-49d822e06d1c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Creating volume efccbe7d-a803-4a3b-8190-49d822e06d1c from snapshot ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] snapshot: ba2952a9-b563-42f6-a614-79887ab03202, volume: efccbe7d-a803-4a3b-8190-49d822e06d1c, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7daff3ca-fbce-4e62-beb0-690c4e10ee26]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:03 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:03 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Flow 'volume_create_manager' (7d0cea88-6500-4620-a84d-408b4ec35238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fb4b2d-ceac-4541-a6f5-d5b2abf9434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95fb4b2d-ceac-4541-a6f5-d5b2abf9434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-923551302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90dd54-c910-41d1-a658-60f3ce4a523e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741cd3457c94d60a7093122fc8853f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:04Z,use_quota=True,user_id='35bc234647184b918e11ff6f274bc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0708890-65a7-491b-8539-b1a21aed6522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0708890-65a7-491b-8539-b1a21aed6522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32dfb9-64f4-4d72-b0e9-2854e4d72397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32dfb9-64f4-4d72-b0e9-2854e4d72397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d90dd54-c910-41d1-a658-60f3ce4a523e', 'volume_name': 'volume-7d90dd54-c910-41d1-a658-60f3ce4a523e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd89adb4-2488-4b51-9920-1b83d86e4186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd89adb4-2488-4b51-9920-1b83d86e4186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e370003-cd73-496a-8891-d5ae453dd1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Volume 7d90dd54-c910-41d1-a658-60f3ce4a523e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d90dd54-c910-41d1-a658-60f3ce4a523e', 'volume_size': 1} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:04 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.463s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d9ec73-365e-49f0-b574-5f48d8a04cfc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:04 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:17:04 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:04 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.410s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:17:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:04 devstack sudo[113967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:04 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:08 devstack sudo[113981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:08 devstack sudo[113981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:09 devstack sudo[113981]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:17:09 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 4.829s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:17:09 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 212.00 MB/s Aug 03 09:17:09 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c is being set with open permissions: ugo+rw Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:09 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:09 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (8dbe2aa0-cbaf-4eba-9e3f-bd205a37ba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1c307c-c6c3-4ca9-b4b1-2898bbb1d89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1c307c-c6c3-4ca9-b4b1-2898bbb1d89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946523853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bacac5-a088-4f93-b44e-6ba302560cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:09Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6323a38-fea1-4eee-8c48-d2197c975c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6323a38-fea1-4eee-8c48-d2197c975c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b97105-6a4e-4023-adfd-3f3be6711c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b97105-6a4e-4023-adfd-3f3be6711c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bacac5-a088-4f93-b44e-6ba302560cce', 'volume_name': 'volume-52bacac5-a088-4f93-b44e-6ba302560cce', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76298e92-b693-4a2a-a3b5-ce686b2ca2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76298e92-b693-4a2a-a3b5-ce686b2ca2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea93012-5568-466b-a7af-0166f49472ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Volume 52bacac5-a088-4f93-b44e-6ba302560cce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bacac5-a088-4f93-b44e-6ba302560cce', 'volume_size': 1} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:09 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" released by "_copy_volume_from_snapshot" :: held 6.063s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202-efccbe7d-a803-4a3b-8190-49d822e06d1c" released by "_create_volume_from_snapshot" :: held 6.123s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.139s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.628s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-923551302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90dd54-c910-41d1-a658-60f3ce4a523e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f741cd3457c94d60a7093122fc8853f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:04Z,use_quota=True,user_id='35bc234647184b918e11ff6f274bc52f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Creating volume 7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:09 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:09 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e 1073741824 Aug 03 09:17:09 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb463bc-aedf-458a-9ad1-6711b559437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efccbe7d-a803-4a3b-8190-49d822e06d1c', 'volume_size': 1, 'snapshot_id': 'ba2952a9-b563-42f6-a614-79887ab03202'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95677a6-d2c2-47d3-a3ed-92db4358e207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:09 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Volume volume-efccbe7d-a803-4a3b-8190-49d822e06d1c (efccbe7d-a803-4a3b-8190-49d822e06d1c): created successfully Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95677a6-d2c2-47d3-a3ed-92db4358e207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (226baa2c-4cfc-46ec-99f6-aefea221d282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-264bf212-d507-40bf-8ecd-a0264b76791f tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:17:10 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e 1073741824" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:10 devstack sudo[113992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e Aug 03 09:17:10 devstack sudo[113992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:10 devstack sudo[113992]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.823s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-946523853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bacac5-a088-4f93-b44e-6ba302560cce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:09Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Creating volume 52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:10 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:10 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce 1073741824 Aug 03 09:17:10 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e370003-cd73-496a-8891-d5ae453dd1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d90dd54-c910-41d1-a658-60f3ce4a523e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a077c21-070a-4206-ab51-7026629f32ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:10 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Volume volume-7d90dd54-c910-41d1-a658-60f3ce4a523e (7d90dd54-c910-41d1-a658-60f3ce4a523e): created successfully Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a077c21-070a-4206-ab51-7026629f32ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Flow 'volume_create_manager' (7d0cea88-6500-4620-a84d-408b4ec35238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1e3cb4a2-ff94-4aa4-8a47-55f6ded6b415 tempest-CinderUnicodeTest-1649928661 None] Created volume successfully. Aug 03 09:17:10 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce 1073741824" returned: 0 in 0.424s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:10 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce Aug 03 09:17:10 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:11 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce" returned: 0 in 0.230s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.746s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea93012-5568-466b-a7af-0166f49472ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bacac5-a088-4f93-b44e-6ba302560cce', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59df98b-8154-4a7a-9c58-12f0f897d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot e2af3387-3232-43fa-839c-5a48e813826b of volume efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:11 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Volume volume-52bacac5-a088-4f93-b44e-6ba302560cce (52bacac5-a088-4f93-b44e-6ba302560cce): created successfully Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59df98b-8154-4a7a-9c58-12f0f897d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (8dbe2aa0-cbaf-4eba-9e3f-bd205a37ba25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6506fcea-2204-4c28-ba2e-21fdce13d912]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b8f2a7ce-3e49-45b5-bb64-901e96c38d92 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:17:11 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:11 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:11 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.389s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:11 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b 1G Aug 03 09:17:11 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:12 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b 1G" returned: 0 in 0.491s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efccbe7d-a803-4a3b-8190-49d822e06d1c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:12 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efccbe7d-a803-4a3b-8190-49d822e06d1c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:12 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:12 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efccbe7d-a803-4a3b-8190-49d822e06d1c -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:12 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b is being set with open permissions: ugo+rw Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:12 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:12 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:12 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:12 devstack sudo[114022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info Aug 03 09:17:12 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:12 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:12 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info is being set with open permissions: ugo+rw Aug 03 09:17:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:12 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info Aug 03 09:17:12 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:13 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.info" returned: 0 in 0.241s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.028s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Creating offline snapshot adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 of volume 7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d02de-1932-492d-9045-c763cf0a22d5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-57dfd405-0e5b-4d60-b7ac-abc61fb0cf9e tempest-VolumeDependencyTests-878745567 None] Create snapshot completed successfully Aug 03 09:17:13 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e Aug 03 09:17:13 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:13 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e" returned: 0 in 0.361s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:13 devstack sudo[114033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 1G Aug 03 09:17:13 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:13 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 1G" returned: 0 in 0.441s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90dd54-c910-41d1-a658-60f3ce4a523e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:13 devstack sudo[114038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90dd54-c910-41d1-a658-60f3ce4a523e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 Aug 03 09:17:13 devstack sudo[114038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (995ed5bc-aedb-4236-95fe-2a79cd0f77a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df19b92-da9c-4f39-9570-5b3ee95ee249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df19b92-da9c-4f39-9570-5b3ee95ee249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-776265480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be23257-bc01-483d-85c7-b5c94b4d848f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2af3387-3232-43fa-839c-5a48e813826b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:14Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9021e720-e73e-47b4-803c-122224be3d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9021e720-e73e-47b4-803c-122224be3d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b51eb-b623-485a-ac00-4f5e94894193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b51eb-b623-485a-ac00-4f5e94894193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2be23257-bc01-483d-85c7-b5c94b4d848f', 'volume_name': 'volume-2be23257-bc01-483d-85c7-b5c94b4d848f', 'volume_size': 1, 'snapshot_id': 'e2af3387-3232-43fa-839c-5a48e813826b'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e00f6fe-d59c-4d6d-9146-d48c2b189484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e00f6fe-d59c-4d6d-9146-d48c2b189484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13ae0c7-3e8c-4d6a-af8e-5f0ec684694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Volume 2be23257-bc01-483d-85c7-b5c94b4d848f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2be23257-bc01-483d-85c7-b5c94b4d848f', 'volume_size': 1, 'snapshot_id': 'e2af3387-3232-43fa-839c-5a48e813826b'} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:14 devstack sudo[114038]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90dd54-c910-41d1-a658-60f3ce4a523e -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:14 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 is being set with open permissions: ugo+rw Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:14 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 Aug 03 09:17:14 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:14 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" returned: 0 in 0.232s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:14 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info Aug 03 09:17:14 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:14 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:14 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info is being set with open permissions: ugo+rw Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:14 devstack sudo[114049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info Aug 03 09:17:14 devstack sudo[114049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:14 devstack sudo[114049]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.info" returned: 0 in 0.240s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.931s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot 186a64c3-6d86-4196-ae28-84b266e96ac6 of volume 52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:15 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-08bfac14-c8f2-4ef5-adc4-0ea48a499200 tempest-CinderUnicodeTest-1649928661 None] Create snapshot completed successfully Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[499e76b7-8ff7-44a0-9f30-182bf3ab0e81]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:15 devstack sudo[114052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce Aug 03 09:17:15 devstack sudo[114052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:15 devstack sudo[114052]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce" returned: 0 in 0.357s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:15 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 1G Aug 03 09:17:15 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:15 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 1G" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bacac5-a088-4f93-b44e-6ba302560cce -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:15 devstack sudo[114063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bacac5-a088-4f93-b44e-6ba302560cce -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 Aug 03 09:17:15 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bacac5-a088-4f93-b44e-6ba302560cce -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:16 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 is being set with open permissions: ugo+rw Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:16 devstack sudo[114069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 Aug 03 09:17:16 devstack sudo[114069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-quobyte-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Deleting offline snapshot adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 of volume 7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] snapshot_file for this snap is: volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db05dc3-82a9-4365-8343-f47ec57aa755]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:16 devstack sudo[114069]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:16 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 Aug 03 09:17:16 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack sudo[114074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info Aug 03 09:17:16 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" returned: 0 in 0.398s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:16 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d90dd54-c910-41d1-a658-60f3ce4a523e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:16 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info is being set with open permissions: ugo+rw Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafe0371-fba4-4f88-b374-b99663dcabdf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:16 devstack sudo[114081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info Aug 03 09:17:16 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack sudo[114082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e Aug 03 09:17:16 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:16 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.info" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.879s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b-2be23257-bc01-483d-85c7-b5c94b4d848f" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b-2be23257-bc01-483d-85c7-b5c94b4d848f" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Creating volume 2be23257-bc01-483d-85c7-b5c94b4d848f from snapshot e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:17 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-96dad7b8-2284-49ca-8adc-8c59449fcab0 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] snapshot: e2af3387-3232-43fa-839c-5a48e813826b, volume: 2be23257-bc01-483d-85c7-b5c94b4d848f, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[deadbd18-0f97-4804-97d9-06121364447c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 Aug 03 09:17:17 devstack sudo[114090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-186a64c3-6d86-4196-ae28-84b266e96ac6-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:17 devstack sudo[114089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:17 devstack sudo[114089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-186a64c3-6d86-4196-ae28-84b266e96ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-186a64c3-6d86-4196-ae28-84b266e96ac6" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-186a64c3-6d86-4196-ae28-84b266e96ac6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot 186a64c3-6d86-4196-ae28-84b266e96ac6 of volume 52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[536ff2de-1f61-42b4-9c5c-a95026a07306]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 Aug 03 09:17:17 devstack sudo[114093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack sudo[114089]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efccbe7d-a803-4a3b-8190-49d822e06d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:17 devstack sudo[114090]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1795628a-6bc6-414e-98f2-eaee988fd275]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4 Aug 03 09:17:17 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:17 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack sudo[114093]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52bacac5-a088-4f93-b44e-6ba302560cce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4751a-de3c-43ce-864e-2c3100aa96c9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e.adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" returned: 0 in 0.267s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4" released by "_delete_snapshot" :: held 1.587s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" released by "delete_snapshot" :: held 1.612s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Created reservations ['37c1e91b-10b2-42c1-b343-b238fedc476c', '3c7a7545-1d60-4e84-a671-e75ba24e6e75', '19a608a1-a95c-402a-b8c7-0ef652a6cbbe', '1be565dc-d05e-4993-b1d5-9e46c16990f0'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:17 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce Aug 03 09:17:17 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:17 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:17:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:17 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f Aug 03 09:17:17 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Delete snapshot completed successfully. Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7b934a4d-e99a-41ae-a542-caf22471c324 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-adeb48c2-8c8b-4f97-b095-4ef13ae8a4d4-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:18 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:18 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 Aug 03 09:17:18 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-7d90dd54-c910-41d1-a658-60f3ce4a523e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-7d90dd54-c910-41d1-a658-60f3ce4a523e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:18 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f" returned: 0 in 0.559s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:17:18 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 09:17:18 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f is being set with open permissions: ugo+rw Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0598e3c-f550-4134-b0b6-b6c86ab7c2d8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:18 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f Aug 03 09:17:18 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:18 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6" returned: 0 in 0.415s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:18 devstack sudo[114129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e Aug 03 09:17:18 devstack sudo[114129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:18 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6 Aug 03 09:17:18 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:18 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" released by "_copy_volume_from_snapshot" :: held 1.725s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b-2be23257-bc01-483d-85c7-b5c94b4d848f" released by "_create_volume_from_snapshot" :: held 1.807s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 1.849s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13ae0c7-3e8c-4d6a-af8e-5f0ec684694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be23257-bc01-483d-85c7-b5c94b4d848f', 'volume_size': 1, 'snapshot_id': 'e2af3387-3232-43fa-839c-5a48e813826b'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f26415a-1ff0-4c0b-8c64-4f3c84805590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:18 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce.186a64c3-6d86-4196-ae28-84b266e96ac6" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Volume volume-2be23257-bc01-483d-85c7-b5c94b4d848f (2be23257-bc01-483d-85c7-b5c94b4d848f): created successfully Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f26415a-1ff0-4c0b-8c64-4f3c84805590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (995ed5bc-aedb-4236-95fe-2a79cd0f77a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-186a64c3-6d86-4196-ae28-84b266e96ac6" released by "_delete_snapshot" :: held 1.621s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:18 devstack sudo[114129]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" released by "delete_snapshot" :: held 1.650s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b770e79a-4250-45df-a0ec-ab2caf3088db tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:17:18 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e Aug 03 09:17:18 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Created reservations ['2ff14cde-ff12-41ce-b4e0-6c462c233561', '93d9e16e-e7d3-449e-aa3b-53fc6c83e6d6', '326954fe-0d11-4e3f-8e41-e68cb4879826', '398eb8c4-1ae8-4a07-97be-2aba1d3ba7e4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e8a765d4-00e2-41f4-8c15-d9432b7639e9 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-186a64c3-6d86-4196-ae28-84b266e96ac6-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:19 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-7d90dd54-c910-41d1-a658-60f3ce4a523e" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-7d90dd54-c910-41d1-a658-60f3ce4a523e" released by "delete_volume" :: held 0.752s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-ba2952a9-b563-42f6-a614-79887ab03202-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Created reservations ['3d3f9539-a579-48da-aea7-8bc9bc3340d2', '32f22e04-3ab7-412d-8175-ff253ce2403e', 'c40e23a2-0ca6-4e53-bfe5-1907ea7a3716', '896395eb-3170-4b3e-8b5a-63392063888c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-ba2952a9-b563-42f6-a614-79887ab03202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot ba2952a9-b563-42f6-a614-79887ab03202 of volume 018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58c67e-a18c-46e0-b98d-e657efc183e2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-52bacac5-a088-4f93-b44e-6ba302560cce-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack sudo[114145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:19 devstack sudo[114145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-52bacac5-a088-4f93-b44e-6ba302560cce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack sudo[114144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:19 devstack sudo[114144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-1e49efd4-812a-4aa1-ae0b-04e743b2ae98-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[800c44b5-5768-488d-b38a-535f5824e8c0]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-1e49efd4-812a-4aa1-ae0b-04e743b2ae98-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "cinder-quobyte-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:19 devstack sudo[114145]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:19 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce Aug 03 09:17:19 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Deleted volume successfully. Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9330eb22-add0-45d0-b43f-d8a9e3f84294]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-51f89690-8cd8-4dd9-b1ee-9b7e2753c635 tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-7d90dd54-c910-41d1-a658-60f3ce4a523e-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:19 devstack sudo[114144]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.502s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:19 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 Aug 03 09:17:19 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5a2f09-9bb0-40da-a9d9-589c0efb8e96]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:17:20 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce" returned: 0 in 0.455s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce Aug 03 09:17:20 devstack sudo[114161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" returned: 0 in 0.400s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98 Aug 03 09:17:20 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack sudo[114161]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-52bacac5-a088-4f93-b44e-6ba302560cce" returned: 0 in 0.252s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-52bacac5-a088-4f93-b44e-6ba302560cce" released by "delete_volume" :: held 0.807s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Created reservations ['88526aa9-fe00-41f9-b4ff-407cfe245129', '3f2a1d24-90a4-435d-9ba6-b8f6a29273de', '88cebf7f-5121-4f5f-b79b-0fc653c2ef10', 'e203ec42-91ab-46f0-85e6-71116b2036fe'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:20 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.547s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:20 devstack sudo[114173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" returned: 0 in 0.325s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack sudo[114175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:20 devstack sudo[114175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-quobyte-1e49efd4-812a-4aa1-ae0b-04e743b2ae98" released by "delete_volume" :: held 0.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Created reservations ['79ca8424-4b6f-49fc-9511-048cbf2b54d8', '6359b4ae-ba68-460a-85f0-0c71906a71b1', '8565be65-df56-4533-b14f-1c7022f8b4f6', 'f318c853-566f-4b82-a956-10ad107aca06'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:20 devstack sudo[114175]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:20 devstack sudo[114180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:20 devstack sudo[114180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-40f35d97-7885-4ef5-8060-0fac1944ea51 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-52bacac5-a088-4f93-b44e-6ba302560cce-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:20 devstack sudo[114173]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.510s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:21 devstack sudo[114183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202 Aug 03 09:17:21 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:21 devstack sudo[114180]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Deleted volume successfully. Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4aa5161d-4f99-419b-930f-fd17611dcabf tempest-CinderUnicodeTest-1649928661 None] Lock "cinder-1e49efd4-812a-4aa1-ae0b-04e743b2ae98-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:21 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (2341dddb-2ce7-4918-a1ce-4835b92b7ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c676a6a7-ea0f-47ef-b501-956a3cdf8481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5.ba2952a9-b563-42f6-a614-79887ab03202" returned: 0 in 0.338s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c676a6a7-ea0f-47ef-b501-956a3cdf8481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420443863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e84f28e-607d-4ec4-82cd-cddad7a733b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:21Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005b421e-0d09-4b95-838b-9830490a7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005b421e-0d09-4b95-838b-9830490a7faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb9d7ce-6174-4915-9f39-33ad3884b78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bb9d7ce-6174-4915-9f39-33ad3884b78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e84f28e-607d-4ec4-82cd-cddad7a733b5', 'volume_name': 'volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8162a0b-a4c3-4e64-8b9c-da641a33f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8162a0b-a4c3-4e64-8b9c-da641a33f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b62883d-5eb4-4ac8-9200-982a139bf83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Volume 5e84f28e-607d-4ec4-82cd-cddad7a733b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5', 'volume_size': 1} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-420443863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e84f28e-607d-4ec4-82cd-cddad7a733b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:21Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Creating volume 5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:21 devstack sudo[114187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 1073741824 Aug 03 09:17:21 devstack sudo[114187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-ba2952a9-b563-42f6-a614-79887ab03202" released by "_delete_snapshot" :: held 2.099s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" released by "delete_snapshot" :: held 2.138s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Created reservations ['7bc977c7-e1e7-4efe-8eeb-f6bde3f6e92d', 'da7c73b1-909d-49da-aebd-d068bbe77ab6', 'eb3faae9-7a49-4f8d-aef5-ca9745e0c826', 'f364f3e1-cb5f-4f31-a4fd-daecd9f968dc'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Delete snapshot completed successfully. Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-49827f76-fb98-42fe-9a1d-0299432733bc tempest-VolumeDependencyTests-878745567 None] Lock "cinder-ba2952a9-b563-42f6-a614-79887ab03202-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:21 devstack sudo[114187]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 1073741824" returned: 0 in 0.475s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:21 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 Aug 03 09:17:21 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:22 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b62883d-5eb4-4ac8-9200-982a139bf83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c45d32-3a0c-4564-9010-0b66519e4067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Volume volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 (5e84f28e-607d-4ec4-82cd-cddad7a733b5): created successfully Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1c45d32-3a0c-4564-9010-0b66519e4067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (2341dddb-2ce7-4918-a1ce-4835b92b7ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-229d0fa2-c5ba-4fb0-b9e6-47b86a9a122c tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-e2af3387-3232-43fa-839c-5a48e813826b-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-e2af3387-3232-43fa-839c-5a48e813826b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot e2af3387-3232-43fa-839c-5a48e813826b of volume efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a929df-89ae-499d-a642-477e75d80671]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:22 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:22 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:22 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.382s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efccbe7d-a803-4a3b-8190-49d822e06d1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf84ffc-cab2-475e-8aeb-039ab2d9d4e8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:23 devstack sudo[114201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:23 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:23 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.397s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:23 devstack sudo[114206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:23 devstack sudo[114206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot f726e483-348a-4acd-badc-cb78b5dd7705 of volume 5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f234266b-46cc-4fd5-b82b-99a422cbb1c5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:23 devstack sudo[114208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 Aug 03 09:17:23 devstack sudo[114208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:23 devstack sudo[114206]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:23 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b Aug 03 09:17:23 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:24 devstack sudo[114208]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:24 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 1G Aug 03 09:17:24 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:24 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c.e2af3387-3232-43fa-839c-5a48e813826b" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-e2af3387-3232-43fa-839c-5a48e813826b" released by "_delete_snapshot" :: held 1.569s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" released by "delete_snapshot" :: held 1.603s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Created reservations ['b4c309b4-b2e6-40fe-9923-7a50cc767e2f', '26402de1-bc0e-40e5-a67e-c1cbf3351156', 'dba6f6d7-1e59-4d99-a831-d862f7cf7789', '03dde19e-5345-48e5-81de-2686a7aa40aa'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Delete snapshot completed successfully. Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4b5aaed5-697d-4712-95eb-e9c94a69e282 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-e2af3387-3232-43fa-839c-5a48e813826b-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-77e7da25-7e58-4942-bce3-988067ff9426 tempest-ProjectAdminTests-1112479064 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7364234924316, 'free_capacity_gb': 1775.7364234924316, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88796) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 09:17:24 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 1G" returned: 0 in 0.443s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:24 devstack sudo[114225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 Aug 03 09:17:24 devstack sudo[114225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:24 devstack sudo[114225]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705" returned: 0 in 0.365s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:24 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 is being set with open permissions: ugo+rw Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd1c6a-7f55-4285-99b9-35c8e7a13ee7]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:24 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 Aug 03 09:17:24 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:24 devstack sudo[114231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:17:24 devstack sudo[114231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:25 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:25 devstack sudo[114235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info Aug 03 09:17:25 devstack sudo[114235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:25 devstack sudo[114231]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.421s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:25 devstack sudo[114240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5 Aug 03 09:17:25 devstack sudo[114240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:25 devstack sudo[114235]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info" returned: 0 in 0.283s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:25 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info is being set with open permissions: ugo+rw Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:25 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info Aug 03 09:17:25 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:25 devstack sudo[114240]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5" released by "delete_volume" :: held 0.765s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Created reservations ['7765ca34-cc94-4176-bb8b-05918f57b80b', '6f1d88b5-a5d9-4007-bbd7-c96c824d14d7', 'e8b47a34-23d6-4af3-9e19-a13b12048ce9', 'fbb53aee-1bf1-466b-b2a0-b803f73d6f3f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:25 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.info" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:25 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:25 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1291256e-0c2d-4c1a-99fc-1d4b7f4d426a tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-efccbe7d-a803-4a3b-8190-49d822e06d1c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-efccbe7d-a803-4a3b-8190-49d822e06d1c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:25 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:26 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:26 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f31c781-9d50-43d4-aacb-a062f70fa77d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-06e70158-143a-4f5c-a1ab-230b5da8026c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-018f8d9f-ba6f-4cc1-ae63-2d173280c7c5-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:26 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:26 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:26 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.437s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:26 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c Aug 03 09:17:26 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-f726e483-348a-4acd-badc-cb78b5dd7705-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:26 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-efccbe7d-a803-4a3b-8190-49d822e06d1c" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-f726e483-348a-4acd-badc-cb78b5dd7705-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-efccbe7d-a803-4a3b-8190-49d822e06d1c" released by "delete_volume" :: held 0.788s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-f726e483-348a-4acd-badc-cb78b5dd7705" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-f726e483-348a-4acd-badc-cb78b5dd7705" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot f726e483-348a-4acd-badc-cb78b5dd7705 of volume 5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01eabab-24df-47a9-bcc5-ce766f733641]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:26 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Created reservations ['bc284560-ff92-4d62-83b7-28b669aac03e', 'e91b955d-59dc-4c98-a048-786a6688d888', 'ad3860ab-8556-4c8f-946f-600fb2f966cc', '0d186d1c-53f9-4a2f-850b-ae75d645863f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:26 devstack sudo[114258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 Aug 03 09:17:26 devstack sudo[114258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:27 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:27 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-2be23257-bc01-483d-85c7-b5c94b4d848f-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-2be23257-bc01-483d-85c7-b5c94b4d848f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe052474-5499-49d1-bb42-2e9d71224e22]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:27 devstack sudo[114258]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705" returned: 0 in 0.467s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7ab6f0-5b38-4d70-bed2-03397a5354ef]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:27 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f Aug 03 09:17:27 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e4026bc1-c3d9-492c-a297-b02316b1a70c tempest-VolumeDependencyTests-878745567 None] Lock "cinder-efccbe7d-a803-4a3b-8190-49d822e06d1c-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:27 devstack sudo[114267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 Aug 03 09:17:27 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f" returned: 0 in 0.409s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:27 devstack sudo[114273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f Aug 03 09:17:27 devstack sudo[114273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5" returned: 0 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:27 devstack sudo[114278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 Aug 03 09:17:27 devstack sudo[114278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:27 devstack sudo[114273]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2be23257-bc01-483d-85c7-b5c94b4d848f" returned: 0 in 0.270s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:27 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-2be23257-bc01-483d-85c7-b5c94b4d848f" released by "delete_volume" :: held 0.724s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Created reservations ['99042849-0028-4e9d-89c3-883a5fbdb078', '0ee26d04-fb32-4f35-b381-d44260b9341d', 'cc30af87-a6b8-439a-9600-f815d67074bc', 'fa8849c0-6877-4832-9197-d9b142ee4e9d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:28 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:28 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:28 devstack sudo[114278]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705" returned: 0 in 0.396s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:28 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705 Aug 03 09:17:28 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:28 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a3545c9c-33e6-4140-a25c-cd9b7e739642 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-2be23257-bc01-483d-85c7-b5c94b4d848f-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:28 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5.f726e483-348a-4acd-badc-cb78b5dd7705" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-f726e483-348a-4acd-badc-cb78b5dd7705" released by "_delete_snapshot" :: held 1.803s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" released by "delete_snapshot" :: held 1.835s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Created reservations ['b6706295-b43c-4b64-b4d8-3bd4370023ba', 'c85b3fee-7aaf-4e79-8922-9306afa43e62', '20bbe34e-24d3-4519-b580-8e0275c582e3', '007c5c9c-c9b6-4d84-98f4-f99976235fde'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:28 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-517892ca-dc2f-4d68-baff-2846dcb46549 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-f726e483-348a-4acd-badc-cb78b5dd7705-delete_snapshot" released by "delete_snapshot" :: held 2.062s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (28a7c6cc-9e59-485c-9d4d-5968a24fee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1adcd-5334-4cf8-8e93-30bbb6519a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54f1adcd-5334-4cf8-8e93-30bbb6519a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1231350179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fcd9d-fe4c-48e2-b873-36e0f7087937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:29Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1c8771-c08c-4e3f-a421-f058ea9b652a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b1c8771-c08c-4e3f-a421-f058ea9b652a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521e417a-d033-4f25-8c68-edc03d0e37a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (521e417a-d033-4f25-8c68-edc03d0e37a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717fcd9d-fe4c-48e2-b873-36e0f7087937', 'volume_name': 'volume-717fcd9d-fe4c-48e2-b873-36e0f7087937', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5340dc7-145f-4e5a-9ca6-bbf486a39692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5340dc7-145f-4e5a-9ca6-bbf486a39692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51da86d9-6b5e-43d7-9627-3491d067405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Volume 717fcd9d-fe4c-48e2-b873-36e0f7087937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717fcd9d-fe4c-48e2-b873-36e0f7087937', 'volume_size': 1} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1231350179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717fcd9d-fe4c-48e2-b873-36e0f7087937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:29Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Creating volume 717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:29 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-5e84f28e-607d-4ec4-82cd-cddad7a733b5-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:29 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 1073741824 Aug 03 09:17:29 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-5e84f28e-607d-4ec4-82cd-cddad7a733b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[709b61e9-0427-45c8-bed9-99949b627bc2]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:29 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 Aug 03 09:17:29 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:29 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 1073741824" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:29 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:29 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:29 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:29 devstack sudo[114304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5 Aug 03 09:17:29 devstack sudo[114304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:29 devstack sudo[114304]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-5e84f28e-607d-4ec4-82cd-cddad7a733b5" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:29 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-5e84f28e-607d-4ec4-82cd-cddad7a733b5" released by "delete_volume" :: held 0.804s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51da86d9-6b5e-43d7-9627-3491d067405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717fcd9d-fe4c-48e2-b873-36e0f7087937', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2078f462-c458-424d-bc92-dbad4238bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:29 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Volume volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 (717fcd9d-fe4c-48e2-b873-36e0f7087937): created successfully Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2078f462-c458-424d-bc92-dbad4238bf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (28a7c6cc-9e59-485c-9d4d-5968a24fee4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-6600210f-2163-4b49-86b2-c612d4e523b3 tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:17:29 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Created reservations ['15770d6f-6ccb-43db-8990-b11712be2d3b', '457791e8-e518-4cbd-a6a6-33c215bd1039', '16cdd589-d849-43f7-8f54-b90c85b16929', 'd4f93573-43db-441b-8750-aef83374b124'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:30 devstack sudo[114309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:30 devstack sudo[114309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:30 devstack sudo[114309]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.293s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:30 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d474202f-798a-4fa9-982d-f9d5698eafc7 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-5e84f28e-607d-4ec4-82cd-cddad7a733b5-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (60979625-eb4f-48f8-b4be-40412ab7fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c392b-4a24-4900-8cae-4b2497ab1687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8c392b-4a24-4900-8cae-4b2497ab1687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039444462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d614a2-d25f-4a3e-a80d-e79ed4a1e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:31Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e1c07e-47dc-4328-a654-6c6ac4c66aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e1c07e-47dc-4328-a654-6c6ac4c66aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64df82c-1b65-430e-aaef-c7c20979e21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64df82c-1b65-430e-aaef-c7c20979e21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d614a2-d25f-4a3e-a80d-e79ed4a1e607', 'volume_name': 'volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3630502-13a7-455c-b694-a2e20884928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3630502-13a7-455c-b694-a2e20884928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f9441f-fb65-43d8-9c00-f5d30f5e51fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:30 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Volume b1d614a2-d25f-4a3e-a80d-e79ed4a1e607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607', 'volume_size': 1} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2039444462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d614a2-d25f-4a3e-a80d-e79ed4a1e607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:31Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Creating volume b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:30 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:30 devstack sudo[114312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 1073741824 Aug 03 09:17:30 devstack sudo[114312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:31 devstack sudo[114312]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 1073741824" returned: 0 in 0.571s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:31 devstack sudo[114318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 Aug 03 09:17:31 devstack sudo[114318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:31 devstack sudo[114318]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.391s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f9441f-fb65-43d8-9c00-f5d30f5e51fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8ab9b1-89d3-41a8-b31a-9c3092f3e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Creating offline snapshot 5c456e9e-2213-46e6-aed0-8b63021bb363 of volume 717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:31 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Volume volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 (b1d614a2-d25f-4a3e-a80d-e79ed4a1e607): created successfully Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8ab9b1-89d3-41a8-b31a-9c3092f3e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (60979625-eb4f-48f8-b4be-40412ab7fc17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd32500-53c7-4ea2-815b-699476bb3732]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8a9f7b5f-7e7d-43a6-b539-b32585330782 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:17:31 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:31 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:32 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:32 devstack sudo[114326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 1G Aug 03 09:17:32 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:32 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 1G" returned: 0 in 0.474s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:32 devstack sudo[114332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:32 devstack sudo[114332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:32 devstack sudo[114332]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:32 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 is being set with open permissions: ugo+rw Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:32 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:32 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:33 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:33 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info Aug 03 09:17:33 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:33 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:33 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info is being set with open permissions: ugo+rw Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:33 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info Aug 03 09:17:33 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:33 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.info" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.824s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot 1b4b46c4-2493-46bb-a7e1-d749107ae5ae of volume b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ececa396-17f5-4992-8b80-af32d7143c56]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:33 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d1ab13b0-7bb4-4300-8a90-3b24984cc87f tempest-VolumeDependencyTests-878745567 None] Create snapshot completed successfully Aug 03 09:17:33 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 Aug 03 09:17:33 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (6201601d-6dc8-4fbc-9c6a-41e0ccc2392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e696cfd1-c46a-4f47-b75e-fd9667a65475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e696cfd1-c46a-4f47-b75e-fd9667a65475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-49982499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1178834-532f-4f18-9a2d-96a245460de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:34Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d4b775-a0fa-4981-a114-a6035f7e7182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76d4b775-a0fa-4981-a114-a6035f7e7182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3488051b-769d-4659-b5ae-1deb8514278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3488051b-769d-4659-b5ae-1deb8514278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1178834-532f-4f18-9a2d-96a245460de6', 'volume_name': 'volume-a1178834-532f-4f18-9a2d-96a245460de6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c4e1a6-3d11-4196-931e-55714c261827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c4e1a6-3d11-4196-931e-55714c261827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be08c468-a884-4d34-9c04-d38a0c8f5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Volume a1178834-532f-4f18-9a2d-96a245460de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1178834-532f-4f18-9a2d-96a245460de6', 'volume_size': 1} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:34 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" returned: 0 in 0.403s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:34 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae 1G Aug 03 09:17:34 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:34 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae 1G" returned: 0 in 0.428s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:34 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae Aug 03 09:17:34 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:34 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (5abd2f20-24e7-4ef8-b930-9b2441da260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf8269f-5bdc-4846-b5ea-818bafed157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf8269f-5bdc-4846-b5ea-818bafed157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-916906702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3d5833a-aed1-4427-aeb3-6e224e89b564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e1f1c1222a54932a1fda11ea9ec79fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5c456e9e-2213-46e6-aed0-8b63021bb363,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:35Z,use_quota=True,user_id='d09a366b7b3540a0bc743db708a55875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:35 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f246f322-7513-42af-b0a2-1831acbec083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f246f322-7513-42af-b0a2-1831acbec083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c734e70-18d2-4c6b-ab0d-b087db9c0bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c734e70-18d2-4c6b-ab0d-b087db9c0bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f3d5833a-aed1-4427-aeb3-6e224e89b564', 'volume_name': 'volume-f3d5833a-aed1-4427-aeb3-6e224e89b564', 'volume_size': 1, 'snapshot_id': '5c456e9e-2213-46e6-aed0-8b63021bb363'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f4f59f-4f4e-408a-b8c7-1cfeb0f17898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f4f59f-4f4e-408a-b8c7-1cfeb0f17898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bd6f42-585c-4a1a-be15-a83b17080ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Volume f3d5833a-aed1-4427-aeb3-6e224e89b564: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f3d5833a-aed1-4427-aeb3-6e224e89b564', 'volume_size': 1, 'snapshot_id': '5c456e9e-2213-46e6-aed0-8b63021bb363'} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae" returned: 0 in 0.392s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:35 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae is being set with open permissions: ugo+rw Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:35 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae Aug 03 09:17:35 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:35 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:35 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info Aug 03 09:17:35 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:35 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:35 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info is being set with open permissions: ugo+rw Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:35 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info Aug 03 09:17:35 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:35 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.info" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.689s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-49982499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1178834-532f-4f18-9a2d-96a245460de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:34Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Creating volume a1178834-532f-4f18-9a2d-96a245460de6 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:35 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:35 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 1073741824 Aug 03 09:17:35 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9871b918-eb84-4eca-95b0-676a4a69f632 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:17:35 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=248,cinder:INSERT=87,cinder:UPDATE=324,cinder:DELETE=26 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-1b4b46c4-2493-46bb-a7e1-d749107ae5ae-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-1b4b46c4-2493-46bb-a7e1-d749107ae5ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-1b4b46c4-2493-46bb-a7e1-d749107ae5ae" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-1b4b46c4-2493-46bb-a7e1-d749107ae5ae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot 1b4b46c4-2493-46bb-a7e1-d749107ae5ae of volume b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0131d1ad-b234-4060-8f68-5885c234f5fd]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:36 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae Aug 03 09:17:36 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:36 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 1073741824" returned: 0 in 0.480s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:36 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 Aug 03 09:17:36 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:36 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca175eb-229c-4689-8360-7b4365a3ec77]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:36 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.564s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363-f3d5833a-aed1-4427-aeb3-6e224e89b564" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363-f3d5833a-aed1-4427-aeb3-6e224e89b564" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Creating volume f3d5833a-aed1-4427-aeb3-6e224e89b564 from snapshot 5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be08c468-a884-4d34-9c04-d38a0c8f5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1178834-532f-4f18-9a2d-96a245460de6', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5730ef4b-cc8b-42a2-ac68-7d5de3f590d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] snapshot: 5c456e9e-2213-46e6-aed0-8b63021bb363, volume: f3d5833a-aed1-4427-aeb3-6e224e89b564, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:17:36 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Volume volume-a1178834-532f-4f18-9a2d-96a245460de6 (a1178834-532f-4f18-9a2d-96a245460de6): created successfully Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5730ef4b-cc8b-42a2-ac68-7d5de3f590d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (6201601d-6dc8-4fbc-9c6a-41e0ccc2392e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:36 devstack sudo[114384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 Aug 03 09:17:36 devstack sudo[114384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9b683fb1-f41f-4a9c-bef2-79bb13ee8b7e tempest-ProjectReaderTests-164739522 None] Created volume successfully. Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb52e70e-11b6-4d54-8370-0562a0d04a84]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:36 devstack sudo[114386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:36 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack sudo[114384]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae Aug 03 09:17:37 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717fcd9d-fe4c-48e2-b873-36e0f7087937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2181c817-d942-4872-9a0e-f160168f1d50]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:37 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-a1178834-532f-4f18-9a2d-96a245460de6-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae Aug 03 09:17:37 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "cinder-a1178834-532f-4f18-9a2d-96a245460de6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-quobyte-a1178834-532f-4f18-9a2d-96a245460de6" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-a1178834-532f-4f18-9a2d-96a245460de6" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a8dbeb-dc9a-4b64-a786-8991bfc05060]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 Aug 03 09:17:37 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 Aug 03 09:17:37 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:37 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607.1b4b46c4-2493-46bb-a7e1-d749107ae5ae" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-1b4b46c4-2493-46bb-a7e1-d749107ae5ae" released by "_delete_snapshot" :: held 1.565s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" released by "delete_snapshot" :: held 1.589s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Created reservations ['677e9a02-c7ba-4e37-8952-e31a513593b5', 'e7b296d3-ad0e-4799-8ca4-f0ca9772ed30', 'f06dc54e-c9ac-47d4-be5f-3945c80d5705', 'fc709b00-cbdd-48d9-bd51-79bf5e8d3fee'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-da5a5b5d-7c5a-4732-a619-b529febae317 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-1b4b46c4-2493-46bb-a7e1-d749107ae5ae-delete_snapshot" released by "delete_snapshot" :: held 1.738s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:37 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:37 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6 Aug 03 09:17:37 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:38 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-a1178834-532f-4f18-9a2d-96a245460de6" returned: 0 in 0.504s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-a1178834-532f-4f18-9a2d-96a245460de6" released by "delete_volume" :: held 1.009s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" acquired by "delete_volume" :: waited 0.056s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d701a815-a6e0-4f5e-8767-0d2b494a9f62]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Created reservations ['33f05fc8-ada0-466f-94de-ca7580d3abcc', 'b5e3f61a-4376-43bd-a09c-4c3a996a87e8', '9251ebfb-f642-4460-8971-687165aa3549', 'd07aaebe-9b6a-4cf8-8f92-c9c88bcd095f'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:39 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 Aug 03 09:17:39 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:39 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:39 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:39 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" returned: 0 in 0.737s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:39 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.458s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:39 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607 Aug 03 09:17:39 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Deleted volume successfully. Aug 03 09:17:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0a3ee632-0d5c-466e-9220-d10fe02d08bd tempest-ProjectReaderTests-164739522 None] Lock "cinder-a1178834-532f-4f18-9a2d-96a245460de6-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:40 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" returned: 0 in 0.912s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607" released by "delete_volume" :: held 1.814s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (33bbbe06-935e-4f6d-a60d-086be80e0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951af103-3756-4a81-bb0e-d7da6d81e563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951af103-3756-4a81-bb0e-d7da6d81e563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314320698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ebb3bf-b6fe-4651-961a-651690d64f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:41Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5b862-453e-41f5-8f86-3eb199d6b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5b862-453e-41f5-8f86-3eb199d6b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba61d8a7-ed13-48c0-ad69-f4f15c2c06cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:40 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba61d8a7-ed13-48c0-ad69-f4f15c2c06cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ebb3bf-b6fe-4651-961a-651690d64f0e', 'volume_name': 'volume-40ebb3bf-b6fe-4651-961a-651690d64f0e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029909f7-88a8-44ec-a489-b243f2dad48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029909f7-88a8-44ec-a489-b243f2dad48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3641a414-4aaf-4909-9728-dff7730d3bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:41 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Volume 40ebb3bf-b6fe-4651-961a-651690d64f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ebb3bf-b6fe-4651-961a-651690d64f0e', 'volume_size': 1} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Created reservations ['5bf2dd68-2ad6-4cea-89de-8c14df1a6d84', '03e09142-3693-4c8d-9f41-c349f2106415', 'bc4c711e-d44f-494a-a08c-4195c0f2e672', '58de5cf4-21bb-4dc6-8765-54e9fee1df10'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:41 devstack sudo[114441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:41 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:42 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.717s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:17:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5fe0ccff-e79e-4222-a756-67e36b30ea12 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b1d614a2-d25f-4a3e-a80d-e79ed4a1e607-delete_volume" released by "delete_volume" :: held 3.593s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:43 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564" returned: 0 in 5.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:17:43 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Converted 1024.00 MB image at 188.97 MB/s Aug 03 09:17:43 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 is being set with open permissions: ugo+rw Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:43 devstack sudo[114445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 Aug 03 09:17:43 devstack sudo[114445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (6ad028fb-1e9a-42ba-a61b-1163afb7b4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8bdb19-a109-4c33-8551-e3b59cb046f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8bdb19-a109-4c33-8551-e3b59cb046f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305763970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd4eab0-6256-4c17-bfd9-e49a385ef332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:43Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45089cc-e706-42ba-9f6f-28119fd5ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45089cc-e706-42ba-9f6f-28119fd5ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983e9c9-856d-4afb-9ad3-5d03fdea25a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983e9c9-856d-4afb-9ad3-5d03fdea25a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd4eab0-6256-4c17-bfd9-e49a385ef332', 'volume_name': 'volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2bec80-f779-48d1-bd48-c811b522713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e2bec80-f779-48d1-bd48-c811b522713c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e526f55c-4014-4ecb-9399-a586a1da8f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Volume 2bd4eab0-6256-4c17-bfd9-e49a385ef332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332', 'volume_size': 1} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:43 devstack sudo[114445]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564" returned: 0 in 0.255s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" released by "_copy_volume_from_snapshot" :: held 6.569s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363-f3d5833a-aed1-4427-aeb3-6e224e89b564" released by "_create_volume_from_snapshot" :: held 6.642s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.665s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.251s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-314320698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ebb3bf-b6fe-4651-961a-651690d64f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:41Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Creating volume 40ebb3bf-b6fe-4651-961a-651690d64f0e {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:43 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:43 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e 1073741824 Aug 03 09:17:43 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12bd6f42-585c-4a1a-be15-a83b17080ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3d5833a-aed1-4427-aeb3-6e224e89b564', 'volume_size': 1, 'snapshot_id': '5c456e9e-2213-46e6-aed0-8b63021bb363'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca0f81b-1d03-4423-b75d-1f0c48157e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:43 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Volume volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 (f3d5833a-aed1-4427-aeb3-6e224e89b564): created successfully Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ca0f81b-1d03-4423-b75d-1f0c48157e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Flow 'volume_create_manager' (5abd2f20-24e7-4ef8-b930-9b2441da260d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:43 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-5bfc189f-9cc8-4bd6-9587-58cca518b2d6 tempest-VolumeDependencyTests-878745567 None] Created volume successfully. Aug 03 09:17:43 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e 1073741824" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:43 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e Aug 03 09:17:43 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-5c456e9e-2213-46e6-aed0-8b63021bb363-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-5c456e9e-2213-46e6-aed0-8b63021bb363-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:43 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Deleting offline snapshot 5c456e9e-2213-46e6-aed0-8b63021bb363 of volume 717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] snapshot_file for this snap is: volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[265a08a6-6e96-4ab6-9c4d-7bbd5361f04e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:44 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-305763970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd4eab0-6256-4c17-bfd9-e49a385ef332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:43Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Creating volume 2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:44 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3641a414-4aaf-4909-9728-dff7730d3bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ebb3bf-b6fe-4651-961a-651690d64f0e', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:44 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 1073741824 Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0fa3bf-a3d8-465c-b30e-6f93f2f50185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:44 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Volume volume-40ebb3bf-b6fe-4651-961a-651690d64f0e (40ebb3bf-b6fe-4651-961a-651690d64f0e): created successfully Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0fa3bf-a3d8-465c-b30e-6f93f2f50185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (33bbbe06-935e-4f6d-a60d-086be80e0a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-909966e0-b852-4156-86b9-a99eb8e03d35 tempest-ProjectReaderTests-164739522 None] Created volume successfully. Aug 03 09:17:44 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:44 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:44 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.417s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-717fcd9d-fe4c-48e2-b873-36e0f7087937(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[27def7bc-fb87-4dcf-8265-732f2ba7ffa5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:44 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 1073741824" returned: 0 in 0.470s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:44 devstack sudo[114468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:44 devstack sudo[114468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:44 devstack sudo[114469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 Aug 03 09:17:44 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:44 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332" returned: 0 in 0.262s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e526f55c-4014-4ecb-9399-a586a1da8f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89677d29-06e3-404c-8e2b-0342f1f0806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Volume volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 (2bd4eab0-6256-4c17-bfd9-e49a385ef332): created successfully Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89677d29-06e3-404c-8e2b-0342f1f0806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (6ad028fb-1e9a-42ba-a61b-1163afb7b4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1d88b248-8d6f-4bfc-b1fa-a64e82498e15 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:17:45 devstack sudo[114468]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.578s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-40ebb3bf-b6fe-4651-961a-651690d64f0e-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:45 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:45 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "cinder-40ebb3bf-b6fe-4651-961a-651690d64f0e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-quobyte-40ebb3bf-b6fe-4651-961a-651690d64f0e" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-40ebb3bf-b6fe-4651-961a-651690d64f0e" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f3a1a-09be-4b03-a2e3-d09db58b0f25]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e Aug 03 09:17:45 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=278,cinder:SELECT=237,cinder:INSERT=89,cinder:DELETE=23 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot d5d60ede-bfc4-4ac1-824c-da9c6db22de3 of volume 2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08445c-3abe-48b1-ad0c-00f5b609cd74]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.460s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 Aug 03 09:17:45 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack sudo[114485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363 Aug 03 09:17:45 devstack sudo[114485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e" returned: 0 in 0.426s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e Aug 03 09:17:45 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack sudo[114485]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937.5c456e9e-2213-46e6-aed0-8b63021bb363" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332" returned: 0 in 0.423s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-5c456e9e-2213-46e6-aed0-8b63021bb363" released by "_delete_snapshot" :: held 1.857s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" released by "delete_snapshot" :: held 1.883s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:45 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 1G Aug 03 09:17:45 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:45 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-40ebb3bf-b6fe-4651-961a-651690d64f0e" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-40ebb3bf-b6fe-4651-961a-651690d64f0e" released by "delete_volume" :: held 0.752s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Created reservations ['38faebd9-ac65-4d1c-beec-967ffa53a94e', '0727a09f-faa0-465e-bc3a-16c4a38ec536', 'b5e64360-a7c9-4779-a883-886aa25d7009', 'cec90407-066b-4767-8797-6c96b841af12'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:45 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Created reservations ['9176d0b2-3d97-4412-a7dd-4aa1f2cb5911', '23ae799c-fac4-403a-8c20-543f24ad5d7a', 'cc057565-2856-4c54-b5a0-fe0e498e0629', '44433ef9-18b7-4eb2-9282-cd1c797ffc8b'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Delete snapshot completed successfully. Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-64c59567-6afc-4c5a-8f76-4c752648205e tempest-VolumeDependencyTests-878745567 None] Lock "cinder-5c456e9e-2213-46e6-aed0-8b63021bb363-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:46 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:46 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-717fcd9d-fe4c-48e2-b873-36e0f7087937-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-717fcd9d-fe4c-48e2-b873-36e0f7087937-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff323cb9-04b9-480a-963e-1f1b4afe0c83]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:46 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Deleted volume successfully. Aug 03 09:17:46 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 1G" returned: 0 in 0.604s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-3da3e414-4a2a-400c-acac-0ae8aefa752a tempest-ProjectReaderTests-164739522 None] Lock "cinder-40ebb3bf-b6fe-4651-961a-651690d64f0e-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:46 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:46 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:46 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 Aug 03 09:17:46 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:46 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.523s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:46 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937 Aug 03 09:17:46 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:46 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (8b6e052a-4c6f-4b85-8369-af9da0739a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7913eb87-d35c-4745-bfc9-3b5e69b537f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3" returned: 0 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:46 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 is being set with open permissions: ugo+rw Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7913eb87-d35c-4745-bfc9-3b5e69b537f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175322024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85405f-b2bc-4fda-9f0a-c8da796f9ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:47Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b0bd84-01fd-4623-aba6-4f0cb03d61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:46 devstack sudo[114553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 Aug 03 09:17:46 devstack sudo[114553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b0bd84-01fd-4623-aba6-4f0cb03d61a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0713e6-4f38-4f08-8fef-dfaaf932071f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0713e6-4f38-4f08-8fef-dfaaf932071f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f85405f-b2bc-4fda-9f0a-c8da796f9ad3', 'volume_name': 'volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7c1c79-23fb-4942-b769-b03f8c59a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be7c1c79-23fb-4942-b769-b03f8c59a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d6c37b-8837-44d4-b35c-1456acd827ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:47 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Volume 8f85405f-b2bc-4fda-9f0a-c8da796f9ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3', 'volume_size': 1} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:47 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-717fcd9d-fe4c-48e2-b873-36e0f7087937" returned: 0 in 0.325s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-717fcd9d-fe4c-48e2-b873-36e0f7087937" released by "delete_volume" :: held 0.913s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Created reservations ['6b849937-f79d-446e-b965-c8ea8c61d7aa', 'c4e3fcc3-a1e6-4fab-93b1-4ae569f09c0a', '95b6af57-0278-48de-889b-aec6dc7c202a', '71821386-bec5-4223-8e49-50e8aac34af9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:47 devstack sudo[114553]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3" returned: 0 in 0.329s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:47 devstack sudo[114560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:47 devstack sudo[114560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-f3d5833a-aed1-4427-aeb3-6e224e89b564-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:47 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:47 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-f3d5833a-aed1-4427-aeb3-6e224e89b564-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b66f2-4a29-4ae7-9aff-81b8fc65f32b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack sudo[114560]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info" returned: 0 in 0.305s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info is being set with open permissions: ugo+rw Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info Aug 03 09:17:47 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:47 devstack sudo[114564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 Aug 03 09:17:47 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:47 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:47 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-609c747a-ad5f-4cde-93aa-96cb1662a398 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-717fcd9d-fe4c-48e2-b873-36e0f7087937-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:47 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.info" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.556s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.921s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175322024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f85405f-b2bc-4fda-9f0a-c8da796f9ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:47Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Creating volume 8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:47 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564" returned: 0 in 0.447s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:47 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:47 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 1073741824 Aug 03 09:17:47 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:48 devstack sudo[114576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564 Aug 03 09:17:48 devstack sudo[114576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e130fb80-f0a3-484c-ab7f-b87587863296 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:17:48 devstack sudo[114576]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-f3d5833a-aed1-4427-aeb3-6e224e89b564" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-quobyte-f3d5833a-aed1-4427-aeb3-6e224e89b564" released by "delete_volume" :: held 0.757s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Created reservations ['361ff4c8-4b99-466b-bda8-a66e6eca44ed', '3cf4495e-5bb4-41c5-901b-aa7e0e3e75c2', '9e967bf2-5ebe-4dfe-9957-374fd250fed7', '9a023ac4-0b72-46d9-8515-e8602271b9b5'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:48 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:48 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:48 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 1073741824" returned: 0 in 0.526s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:48 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 Aug 03 09:17:48 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-d5d60ede-bfc4-4ac1-824c-da9c6db22de3-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-d5d60ede-bfc4-4ac1-824c-da9c6db22de3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:48 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.309s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-d5d60ede-bfc4-4ac1-824c-da9c6db22de3" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:48 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Deleted volume successfully. Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-d5d60ede-bfc4-4ac1-824c-da9c6db22de3" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot d5d60ede-bfc4-4ac1-824c-da9c6db22de3 of volume 2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a92b0137-e385-4e7f-8c1f-fddbf097df34 tempest-VolumeDependencyTests-878745567 None] Lock "cinder-f3d5833a-aed1-4427-aeb3-6e224e89b564-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e88ac-78e2-4798-bb95-72db957b4e19]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:48 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 Aug 03 09:17:48 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:48 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" returned: 0 in 0.418s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d6c37b-8837-44d4-b35c-1456acd827ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df066b50-5ea8-42ac-903d-3a567734f11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:48 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Volume volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 (8f85405f-b2bc-4fda-9f0a-c8da796f9ad3): created successfully Aug 03 09:17:48 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df066b50-5ea8-42ac-903d-3a567734f11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (8b6e052a-4c6f-4b85-8369-af9da0739a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:49 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-86fbaae6-66d0-46a7-b0c4-760340e136b2 tempest-ProjectReaderTests-164739522 None] Created volume successfully. Aug 03 09:17:49 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3" returned: 0 in 0.422s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09def78-fe6a-41fa-902b-5e8f3dd13262]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:49 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 Aug 03 09:17:49 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:49 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332" returned: 0 in 0.385s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:49 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:49 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 Aug 03 09:17:49 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:50 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3" returned: 0 in 0.407s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:50 devstack sudo[114606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3 Aug 03 09:17:50 devstack sudo[114606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "cinder-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-quobyte-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a4ed8-22a6-4030-9690-7b93f35f0ddd]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:50 devstack sudo[114606]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332.d5d60ede-bfc4-4ac1-824c-da9c6db22de3" returned: 0 in 0.370s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:50 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 Aug 03 09:17:50 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-d5d60ede-bfc4-4ac1-824c-da9c6db22de3" released by "_delete_snapshot" :: held 1.708s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" released by "delete_snapshot" :: held 1.743s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Created reservations ['b2c3e191-02b5-4698-899f-f4ca8de6e5aa', '964cd88b-b4b7-4ddd-be81-326ed18ea5c0', '689c1256-48ab-414a-9574-8dddb43a8ebc', '6e123e49-dfad-44eb-8a6d-281e67c877c1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ebdfc1d4-988e-41ca-8331-9b0c168cc383 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-d5d60ede-bfc4-4ac1-824c-da9c6db22de3-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:50 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" returned: 0 in 0.434s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:50 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3 Aug 03 09:17:50 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-2bd4eab0-6256-4c17-bfd9-e49a385ef332-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-2bd4eab0-6256-4c17-bfd9-e49a385ef332-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc4dd3c-4d19-4864-926e-55978eceef28]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:50 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:51 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" returned: 0 in 0.315s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3" released by "delete_volume" :: held 0.802s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:51 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 Aug 03 09:17:51 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Created reservations ['27f8ba2d-e597-43b1-ae2f-768d962e8fbd', '20c05733-4966-4fd6-ba63-2f84e4069ac7', '7772ec0e-813e-4348-9388-ee6ad436ab8a', '94cb2422-6d7f-43ab-bbcb-c8959c881e2a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:51 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:51 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:51 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332" returned: 0 in 0.477s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:51 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332 Aug 03 09:17:51 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:51 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Deleted volume successfully. Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-d0c21093-6ba9-48b9-9f8a-e458883a8739 tempest-ProjectReaderTests-164739522 None] Lock "cinder-8f85405f-b2bc-4fda-9f0a-c8da796f9ad3-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:51 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2bd4eab0-6256-4c17-bfd9-e49a385ef332" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2bd4eab0-6256-4c17-bfd9-e49a385ef332" released by "delete_volume" :: held 0.902s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (6fff4143-f276-4432-8489-1ab1313af7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264204c3-10d3-4c2f-87e9-e28751d33053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (264204c3-10d3-4c2f-87e9-e28751d33053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155641311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41089076-eb30-459f-b6a7-925d5aeb7c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:52Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4efe3-a028-4676-9003-577359dc8e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d4efe3-a028-4676-9003-577359dc8e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f6f812-3bf9-4973-a728-245e8a2456ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f6f812-3bf9-4973-a728-245e8a2456ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41089076-eb30-459f-b6a7-925d5aeb7c73', 'volume_name': 'volume-41089076-eb30-459f-b6a7-925d5aeb7c73', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b40a8-85cd-4404-8b31-e4db360eee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (962b40a8-85cd-4404-8b31-e4db360eee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3425ec66-99ff-4ad7-9746-b07071f7f656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Volume 41089076-eb30-459f-b6a7-925d5aeb7c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41089076-eb30-459f-b6a7-925d5aeb7c73', 'volume_size': 1} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155641311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41089076-eb30-459f-b6a7-925d5aeb7c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76cf0bc782ef45fdbaa380ea20984d66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:52Z,use_quota=True,user_id='6a4c8c445c25454d82f359fdcdaf68e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Creating volume 41089076-eb30-459f-b6a7-925d5aeb7c73 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:52 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Created reservations ['4a75c07e-d843-4dcf-b800-78041251d47c', '8bead2b3-ee72-4be3-b004-d9aaffee0f8e', 'ef31ecf3-fc7d-4b0c-b534-dbff82ddb5a5', 'c5454dcf-9df7-42fb-acb6-1df7f0b2d2df'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:52 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 1073741824 Aug 03 09:17:52 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:52 devstack sudo[114632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:52 devstack sudo[114632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:52 devstack sudo[114632]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.292s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0321a9ab-979e-4dd5-8655-334ae8e8f9d2 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-2bd4eab0-6256-4c17-bfd9-e49a385ef332-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:52 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 1073741824" returned: 0 in 0.506s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:52 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 Aug 03 09:17:52 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:52 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73" returned: 0 in 0.264s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3425ec66-99ff-4ad7-9746-b07071f7f656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41089076-eb30-459f-b6a7-925d5aeb7c73', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15b425d-2312-4588-9165-be90b1a8554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:52 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Volume volume-41089076-eb30-459f-b6a7-925d5aeb7c73 (41089076-eb30-459f-b6a7-925d5aeb7c73): created successfully Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15b425d-2312-4588-9165-be90b1a8554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:52 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Flow 'volume_create_manager' (6fff4143-f276-4432-8489-1ab1313af7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d0dde7aa-eeb3-434f-9f0f-b839b1670421 tempest-ProjectReaderTests-164739522 None] Created volume successfully. Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (cb7be57a-a0af-4586-a768-94e000e0781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc7cfbe-dd58-467f-8ad2-b37363f24288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc7cfbe-dd58-467f-8ad2-b37363f24288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172882924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0de6046-7417-4af8-bb8b-4973a7b15181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:54Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea14a03-2434-47c9-9647-516d37dd2014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea14a03-2434-47c9-9647-516d37dd2014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc18f5d-cc3c-4b5a-a27e-ecd32806e054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bc18f5d-cc3c-4b5a-a27e-ecd32806e054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0de6046-7417-4af8-bb8b-4973a7b15181', 'volume_name': 'volume-b0de6046-7417-4af8-bb8b-4973a7b15181', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e99ea01-48c0-4cf4-acb2-3264fb3fbbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e99ea01-48c0-4cf4-acb2-3264fb3fbbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd092a9-bd52-4bf5-bfdd-3b77363be9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:53 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Volume b0de6046-7417-4af8-bb8b-4973a7b15181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0de6046-7417-4af8-bb8b-4973a7b15181', 'volume_size': 1} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172882924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0de6046-7417-4af8-bb8b-4973a7b15181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:17:54Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Creating volume b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:17:53 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:17:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:53 devstack sudo[114649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 1073741824 Aug 03 09:17:53 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-41089076-eb30-459f-b6a7-925d5aeb7c73-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "cinder-41089076-eb30-459f-b6a7-925d5aeb7c73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Acquiring lock "cinder-quobyte-41089076-eb30-459f-b6a7-925d5aeb7c73" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-41089076-eb30-459f-b6a7-925d5aeb7c73" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e7c2f1-f5e6-4cc2-9efd-ab6ea8260228]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:54 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 Aug 03 09:17:54 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:54 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 1073741824" returned: 0 in 0.458s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:54 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 Aug 03 09:17:54 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:54 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73" returned: 0 in 0.428s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:54 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73 Aug 03 09:17:54 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:54 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd092a9-bd52-4bf5-bfdd-3b77363be9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0de6046-7417-4af8-bb8b-4973a7b15181', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fa693-45f2-4601-b8ec-210cce343b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:17:54 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Volume volume-b0de6046-7417-4af8-bb8b-4973a7b15181 (b0de6046-7417-4af8-bb8b-4973a7b15181): created successfully Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c15fa693-45f2-4601-b8ec-210cce343b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (cb7be57a-a0af-4586-a768-94e000e0781e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:17:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9233939b-813e-406d-9a4e-fb3b8d99795d tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:17:54 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-41089076-eb30-459f-b6a7-925d5aeb7c73" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "cinder-quobyte-41089076-eb30-459f-b6a7-925d5aeb7c73" released by "delete_volume" :: held 0.743s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Created reservations ['97e17b0c-75f8-4dd7-8335-b50f59920cf3', 'a50419ac-b1bf-41a8-af42-f86d1345a0e1', '7b26f011-9bfe-4e7e-872f-f920b1130f30', '91411854-8aba-43c9-b29a-55072d37f56d'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:54 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:17:54 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:55 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:17:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Deleted volume successfully. Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-760bcb5f-0442-4d82-be32-a3667359bc00 tempest-ProjectReaderTests-164739522 None] Lock "cinder-41089076-eb30-459f-b6a7-925d5aeb7c73-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot b5fd4b79-9613-4049-abf7-98345399dafe of volume b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb1fbfa-49f9-4c43-897d-83a48e13a0ec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:55 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 Aug 03 09:17:55 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:56 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:56 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe 1G Aug 03 09:17:56 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:56 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe 1G" returned: 0 in 0.526s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de6046-7417-4af8-bb8b-4973a7b15181 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:56 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de6046-7417-4af8-bb8b-4973a7b15181 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe Aug 03 09:17:56 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:57 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de6046-7417-4af8-bb8b-4973a7b15181 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe" returned: 0 in 0.356s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe is being set with open permissions: ugo+rw Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:57 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe Aug 03 09:17:57 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:57 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:57 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info Aug 03 09:17:57 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:57 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info is being set with open permissions: ugo+rw Aug 03 09:17:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:57 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info Aug 03 09:17:57 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:58 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.info" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:17:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-b1531cac-385d-4069-8b86-028ac8df2863 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-b5fd4b79-9613-4049-abf7-98345399dafe-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b5fd4b79-9613-4049-abf7-98345399dafe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-b5fd4b79-9613-4049-abf7-98345399dafe" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b5fd4b79-9613-4049-abf7-98345399dafe" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot b5fd4b79-9613-4049-abf7-98345399dafe of volume b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a0eace-49d6-4f5c-b0f6-fba7c569b868]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:59 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe Aug 03 09:17:59 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:17:59 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe" returned: 0 in 0.463s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0de6046-7417-4af8-bb8b-4973a7b15181(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d727f72-f247-4c81-86ef-648680c33f74]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:17:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:17:59 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 Aug 03 09:17:59 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:00 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181" returned: 0 in 0.438s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:00 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe Aug 03 09:18:00 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:00 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe" returned: 0 in 0.462s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:00 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe Aug 03 09:18:00 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:00 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181.b5fd4b79-9613-4049-abf7-98345399dafe" returned: 0 in 0.333s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b5fd4b79-9613-4049-abf7-98345399dafe" released by "_delete_snapshot" :: held 1.838s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" released by "delete_snapshot" :: held 1.863s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Created reservations ['51f931ea-0dff-4bd1-a215-55d139585e55', '822a97a9-41ba-489e-8843-3a3f3d6992b4', '17d133ae-8d90-43de-a6bf-2d7dcae1d3a0', 'b74c00a9-1239-42ec-815f-1ba113a178d9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:01 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1720fcc3-4d29-43bb-b843-77ab5b13de57 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b5fd4b79-9613-4049-abf7-98345399dafe-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-b0de6046-7417-4af8-bb8b-4973a7b15181-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b0de6046-7417-4af8-bb8b-4973a7b15181-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[19942793-935e-4568-ac5a-f74fa21f3a55]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:01 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 Aug 03 09:18:01 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:01 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:01 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181 Aug 03 09:18:01 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:02 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b0de6046-7417-4af8-bb8b-4973a7b15181" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-b0de6046-7417-4af8-bb8b-4973a7b15181" released by "delete_volume" :: held 0.780s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Created reservations ['85072242-f773-45ad-bcbb-a4e86e697b10', 'e8ca63f0-0eac-400a-b8e0-8156a716115e', '564e9871-617d-4174-8d78-5696e6b575b2', 'ad04ed2e-6e41-4d66-a55c-884c352347c9'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:02 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:02 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:02 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-0936d81e-1905-494b-aeb0-ef05aec68233 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-b0de6046-7417-4af8-bb8b-4973a7b15181-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:02 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (fc8e2465-796a-4705-99b9-7e9512ebf408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecb589c-b8ab-4a9c-8e32-8ef8a64ea3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecb589c-b8ab-4a9c-8e32-8ef8a64ea3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448601614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83304818-e562-4db8-a09c-05516d068a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:03Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78770d51-8a3c-4e12-8e5d-9b3a45e9336b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78770d51-8a3c-4e12-8e5d-9b3a45e9336b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb9892-02b4-4aca-b185-dde2d82ef03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dcb9892-02b4-4aca-b185-dde2d82ef03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83304818-e562-4db8-a09c-05516d068a00', 'volume_name': 'volume-83304818-e562-4db8-a09c-05516d068a00', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b389111-f8e6-475e-846e-16cdee44bc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b389111-f8e6-475e-846e-16cdee44bc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31ce4ce-d7a3-4294-a4a0-31f6693d6aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:03 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Volume 83304818-e562-4db8-a09c-05516d068a00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83304818-e562-4db8-a09c-05516d068a00', 'volume_size': 1} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1448601614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83304818-e562-4db8-a09c-05516d068a00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:03Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Creating volume 83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:03 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:03 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 1073741824 Aug 03 09:18:03 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:03 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 1073741824" returned: 0 in 0.595s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:03 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 Aug 03 09:18:03 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:04 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00" returned: 0 in 0.286s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31ce4ce-d7a3-4294-a4a0-31f6693d6aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83304818-e562-4db8-a09c-05516d068a00', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d860527-6937-4398-a0f9-2971ac6b585b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:04 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Volume volume-83304818-e562-4db8-a09c-05516d068a00 (83304818-e562-4db8-a09c-05516d068a00): created successfully Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d860527-6937-4398-a0f9-2971ac6b585b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:04 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (fc8e2465-796a-4705-99b9-7e9512ebf408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-81aa16df-7e02-4259-bc1a-2d5814f1a089 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot 7393accc-9810-4212-8b70-c5cad91ed79d of volume 83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6c2db9-0f42-46b4-b949-cb2f3da7b8e5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:05 devstack sudo[114739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 Aug 03 09:18:05 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:05 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00" returned: 0 in 0.554s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:05 devstack sudo[114744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d 1G Aug 03 09:18:05 devstack sudo[114744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:06 devstack sudo[114744]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d 1G" returned: 0 in 0.503s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83304818-e562-4db8-a09c-05516d068a00 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:06 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83304818-e562-4db8-a09c-05516d068a00 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d Aug 03 09:18:06 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:06 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83304818-e562-4db8-a09c-05516d068a00 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d" returned: 0 in 0.333s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:06 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d is being set with open permissions: ugo+rw Aug 03 09:18:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:06 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d Aug 03 09:18:06 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:07 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d" returned: 0 in 0.284s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:07 devstack sudo[114759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info Aug 03 09:18:07 devstack sudo[114759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:07 devstack sudo[114759]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info" returned: 0 in 0.323s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:07 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info is being set with open permissions: ugo+rw Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:07 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info Aug 03 09:18:07 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:07 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.info" returned: 0 in 0.298s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.443s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:07 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9fa1461f-ffa3-4e73-a67c-8fe861e0b1a9 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-7393accc-9810-4212-8b70-c5cad91ed79d-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-7393accc-9810-4212-8b70-c5cad91ed79d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-7393accc-9810-4212-8b70-c5cad91ed79d" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-7393accc-9810-4212-8b70-c5cad91ed79d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot 7393accc-9810-4212-8b70-c5cad91ed79d of volume 83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa00fcbb-d06e-4f41-9849-28b46131e60b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:08 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d Aug 03 09:18:08 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:08 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:08 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:09 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d" returned: 0 in 0.530s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83304818-e562-4db8-a09c-05516d068a00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:09 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d00556-70b4-4c1f-9a3e-7b2612d431fe]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:18:09 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 Aug 03 09:18:09 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:09 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00" returned: 0 in 0.514s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:09 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d Aug 03 09:18:09 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:10 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d" returned: 0 in 0.408s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:10 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d Aug 03 09:18:10 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:10 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00.7393accc-9810-4212-8b70-c5cad91ed79d" returned: 0 in 0.299s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-7393accc-9810-4212-8b70-c5cad91ed79d" released by "_delete_snapshot" :: held 1.870s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" released by "delete_snapshot" :: held 1.894s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Created reservations ['24362ef5-8eaa-4a78-b4f1-73a64fc52d7a', '6cead314-3397-4aa4-8df3-eca184d9b813', 'e6481a78-b0f5-4769-8816-544df5934f7f', '6120bcb9-4ca3-484a-a005-2bdd7728f807'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:10 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-383a190e-39d8-4fe6-9b4f-be98dd63902f tempest-ProjectMemberTests-1055550634 None] Lock "cinder-7393accc-9810-4212-8b70-c5cad91ed79d-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-83304818-e562-4db8-a09c-05516d068a00-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-83304818-e562-4db8-a09c-05516d068a00-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da8425a-a5d7-4562-9cb2-873f7a8535cc]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:11 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 Aug 03 09:18:11 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:11 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00" returned: 0 in 0.472s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:11 devstack sudo[114794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00 Aug 03 09:18:11 devstack sudo[114794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:11 devstack sudo[114794]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-83304818-e562-4db8-a09c-05516d068a00" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-83304818-e562-4db8-a09c-05516d068a00" released by "delete_volume" :: held 0.883s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Created reservations ['bd3ae2c2-ded8-4ac0-b9f1-7f132807e4cc', 'b68e8ca0-1dd0-4bd9-b32a-d365dad0a841', '70cc2d44-0a6b-4620-83b0-830303252955', '1be0f1bd-7d59-44ce-a5a3-73cc8f3d0153'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:11 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:11 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:12 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.310s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8a1379ec-7abd-42a0-8a4f-c98c6fc7a38b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-83304818-e562-4db8-a09c-05516d068a00-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Flow 'volume_create_manager' (bae52bb4-fb2a-4292-92e5-a52d790a582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d432b8-e000-475d-b321-5d618b483dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d432b8-e000-475d-b321-5d618b483dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53775410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e5a573-4e53-42c9-80dc-9c9b9093e4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5fbec7e52946acba7c7575dfe71d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:12Z,use_quota=True,user_id='a87c8374ea664be0b86d4866ed096259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e60fd-6b1d-414d-97ef-9b80038e1c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e60fd-6b1d-414d-97ef-9b80038e1c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd07f029-82bd-42e2-a66d-47ef7d6385b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd07f029-82bd-42e2-a66d-47ef7d6385b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3e5a573-4e53-42c9-80dc-9c9b9093e4d9', 'volume_name': 'volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fae77f-ed65-4b50-9e94-6278057a5e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4fae77f-ed65-4b50-9e94-6278057a5e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d4dfcd-074c-40ab-ba7c-8b04c9503516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:12 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Volume e3e5a573-4e53-42c9-80dc-9c9b9093e4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9', 'volume_size': 1} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-53775410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3e5a573-4e53-42c9-80dc-9c9b9093e4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5fbec7e52946acba7c7575dfe71d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:12Z,use_quota=True,user_id='a87c8374ea664be0b86d4866ed096259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Creating volume e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:12 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:12 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 1073741824 Aug 03 09:18:12 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:13 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 1073741824" returned: 0 in 0.506s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:13 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 Aug 03 09:18:13 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:13 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d4dfcd-074c-40ab-ba7c-8b04c9503516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f921ed2b-9b58-4e75-a6ba-22a5d2fe9468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Volume volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 (e3e5a573-4e53-42c9-80dc-9c9b9093e4d9): created successfully Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f921ed2b-9b58-4e75-a6ba-22a5d2fe9468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Flow 'volume_create_manager' (bae52bb4-fb2a-4292-92e5-a52d790a582b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:13 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-83ce008b-c1a7-44ff-9696-bfe6dedb620c tempest-ProjectReaderTests-1559430304 None] Created volume successfully. Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (fee3e165-72e4-4d4a-8a61-0e0c4923f972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26d462a-3789-44f7-8708-40a2449c58f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26d462a-3789-44f7-8708-40a2449c58f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342401588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922a7dbd-cd66-4033-94ab-89e54fbae663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:13Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbeb34f-3a84-4da7-9324-04e9cbf6a490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dbeb34f-3a84-4da7-9324-04e9cbf6a490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7a430d-8b25-4841-b170-48ae3170163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e7a430d-8b25-4841-b170-48ae3170163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '922a7dbd-cd66-4033-94ab-89e54fbae663', 'volume_name': 'volume-922a7dbd-cd66-4033-94ab-89e54fbae663', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad7b16f-693a-4a26-a5b1-806a85994d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad7b16f-693a-4a26-a5b1-806a85994d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad6380c-a93e-451f-be1a-9c4e63c5fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:13 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Volume 922a7dbd-cd66-4033-94ab-89e54fbae663: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-922a7dbd-cd66-4033-94ab-89e54fbae663', 'volume_size': 1} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-342401588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=922a7dbd-cd66-4033-94ab-89e54fbae663,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:13Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Creating volume 922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:13 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:13 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:13 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 1073741824 Aug 03 09:18:13 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:14 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 1073741824" returned: 0 in 0.518s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:14 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 Aug 03 09:18:14 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:14 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663" returned: 0 in 0.278s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bad6380c-a93e-451f-be1a-9c4e63c5fd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-922a7dbd-cd66-4033-94ab-89e54fbae663', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a57fb3-92f8-4055-b01b-f7b029660d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Volume volume-922a7dbd-cd66-4033-94ab-89e54fbae663 (922a7dbd-cd66-4033-94ab-89e54fbae663): created successfully Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a57fb3-92f8-4055-b01b-f7b029660d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (fee3e165-72e4-4d4a-8a61-0e0c4923f972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7e100900-4df3-4851-9ad3-1d10de987761 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "cinder-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "cinder-quobyte-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-quobyte-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4af31-ca5e-4fb7-a5ba-571621115bf3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:14 devstack sudo[114819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 Aug 03 09:18:14 devstack sudo[114819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:15 devstack sudo[114819]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" returned: 0 in 0.488s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:15 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9 Aug 03 09:18:15 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:15 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-quobyte-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9" released by "delete_volume" :: held 0.810s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Created reservations ['fe727d97-5d51-4f5c-b0de-0edb0d1f3133', '9c8e348f-fab9-4114-a5dd-46487b3414d8', '20762c32-aec8-48d7-91a6-3726bbcf9807', 'a4746c69-317b-4e4c-b527-824992c8496a'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:15 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:15 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot 97e31fbe-afa8-4c8e-973e-5bc6c6585928 of volume 922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa8d102-bac5-4544-93cb-22e24451ae60]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:16 devstack sudo[114829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 Aug 03 09:18:16 devstack sudo[114829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:16 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.373s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Deleted volume successfully. Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2b918ef5-1f0a-453c-a7be-665fcab79073 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-e3e5a573-4e53-42c9-80dc-9c9b9093e4d9-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:16 devstack sudo[114829]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663" returned: 0 in 0.515s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:16 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 1G Aug 03 09:18:16 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Flow 'volume_create_manager' (ad9a9d53-eaec-4ac3-a4ad-7e57d93b13fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3582ef-1bd5-4328-bb9c-3c130bb6b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae3582ef-1bd5-4328-bb9c-3c130bb6b980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049760707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed61d4-2206-4099-8ccb-60b5184df650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5fbec7e52946acba7c7575dfe71d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:16Z,use_quota=True,user_id='a87c8374ea664be0b86d4866ed096259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0089c4-2efa-4d1a-9ce9-cb6ddda383af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a0089c4-2efa-4d1a-9ce9-cb6ddda383af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f544e6a-4430-4477-9ff3-0460c8d108cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f544e6a-4430-4477-9ff3-0460c8d108cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ed61d4-2206-4099-8ccb-60b5184df650', 'volume_name': 'volume-b1ed61d4-2206-4099-8ccb-60b5184df650', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2874be-2b2e-48ed-9b0e-f20a7f5efd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2874be-2b2e-48ed-9b0e-f20a7f5efd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff6e14c-9c47-4cf8-bf63-d59c31880530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:16 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Volume b1ed61d4-2206-4099-8ccb-60b5184df650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ed61d4-2206-4099-8ccb-60b5184df650', 'volume_size': 1} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:16 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 1G" returned: 0 in 0.484s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-922a7dbd-cd66-4033-94ab-89e54fbae663 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:16 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-922a7dbd-cd66-4033-94ab-89e54fbae663 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 Aug 03 09:18:16 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:17 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-922a7dbd-cd66-4033-94ab-89e54fbae663 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928" returned: 0 in 0.321s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:17 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 is being set with open permissions: ugo+rw Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:17 devstack sudo[114846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 Aug 03 09:18:17 devstack sudo[114846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:17 devstack sudo[114846]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928" returned: 0 in 0.294s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:17 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info Aug 03 09:18:17 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:17 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info" returned: 0 in 0.311s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:17 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info is being set with open permissions: ugo+rw Aug 03 09:18:17 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:17 devstack sudo[114852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info Aug 03 09:18:17 devstack sudo[114852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:18 devstack sudo[114852]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.info" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.643s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049760707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ed61d4-2206-4099-8ccb-60b5184df650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc5fbec7e52946acba7c7575dfe71d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:16Z,use_quota=True,user_id='a87c8374ea664be0b86d4866ed096259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Creating volume b1ed61d4-2206-4099-8ccb-60b5184df650 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:18 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:18 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 1073741824 Aug 03 09:18:18 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:18 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-d793ba1e-064c-4a12-94fe-865a2aaffffc tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:18:18 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 1073741824" returned: 0 in 0.496s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:18 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:18 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 Aug 03 09:18:18 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:19 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff6e14c-9c47-4cf8-bf63-d59c31880530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ed61d4-2206-4099-8ccb-60b5184df650', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6424f5-9757-49d9-831b-e63474776cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:19 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Volume volume-b1ed61d4-2206-4099-8ccb-60b5184df650 (b1ed61d4-2206-4099-8ccb-60b5184df650): created successfully Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6424f5-9757-49d9-831b-e63474776cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Flow 'volume_create_manager' (ad9a9d53-eaec-4ac3-a4ad-7e57d93b13fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-97e31fbe-afa8-4c8e-973e-5bc6c6585928-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:19 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c2868fa1-33ab-4b32-a75c-a80c5e7ada5c tempest-ProjectReaderTests-1559430304 None] Created volume successfully. Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-97e31fbe-afa8-4c8e-973e-5bc6c6585928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-97e31fbe-afa8-4c8e-973e-5bc6c6585928" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-97e31fbe-afa8-4c8e-973e-5bc6c6585928" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot 97e31fbe-afa8-4c8e-973e-5bc6c6585928 of volume 922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[35747522-1915-489d-8917-53f3345e97d9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:19 devstack sudo[114865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 Aug 03 09:18:19 devstack sudo[114865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:19 devstack sudo[114865]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928" returned: 0 in 0.409s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-922a7dbd-cd66-4033-94ab-89e54fbae663(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d678bcb-a6ff-483c-bd25-6415dd27d055]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "cinder-b1ed61d4-2206-4099-8ccb-60b5184df650-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-b1ed61d4-2206-4099-8ccb-60b5184df650-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "cinder-quobyte-b1ed61d4-2206-4099-8ccb-60b5184df650" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-quobyte-b1ed61d4-2206-4099-8ccb-60b5184df650" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:19 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 Aug 03 09:18:19 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cfaf3c-1838-4c5a-b3e9-ea13148bc77c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:19 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 Aug 03 09:18:19 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:20 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663" returned: 0 in 0.509s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:20 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 Aug 03 09:18:20 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:20 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:20 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650 Aug 03 09:18:20 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:20 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b1ed61d4-2206-4099-8ccb-60b5184df650" returned: 0 in 0.330s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-quobyte-b1ed61d4-2206-4099-8ccb-60b5184df650" released by "delete_volume" :: held 0.784s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:20 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928" returned: 0 in 0.577s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Created reservations ['b7b05b87-7a57-43cc-96ad-b034e8bbe7cb', 'eafffc2f-2a51-40b9-8c50-286e71da0db5', '2801aab3-2951-4658-81e1-24e51b6f1123', 'afe8b01c-bad1-4fb3-9684-a23efdc2b6e2'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:20 devstack sudo[114889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928 Aug 03 09:18:20 devstack sudo[114889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:21 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:21 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:21 devstack sudo[114889]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663.97e31fbe-afa8-4c8e-973e-5bc6c6585928" returned: 0 in 0.394s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-97e31fbe-afa8-4c8e-973e-5bc6c6585928" released by "_delete_snapshot" :: held 2.048s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" released by "delete_snapshot" :: held 2.074s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Created reservations ['18dc7f8e-b672-4c40-9621-89fd68f067f9', '66f75ac5-a07c-4602-9947-ad11df0a02bd', '34979119-72fd-4314-b5c9-59b5c8a0d27a', 'a1b6a797-a164-4475-903a-08f25765ae77'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:21 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.401s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Deleted volume successfully. Aug 03 09:18:21 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-26a8ee5e-5d2b-48bc-a6a1-4eaf1508acd0 tempest-ProjectReaderTests-1559430304 None] Lock "cinder-b1ed61d4-2206-4099-8ccb-60b5184df650-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-051d12b3-566a-4fae-9cd0-8dded4955164 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-97e31fbe-afa8-4c8e-973e-5bc6c6585928-delete_snapshot" released by "delete_snapshot" :: held 2.293s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Flow 'volume_create_manager' (c7b86528-2b78-4e0e-b29d-99f7c59e8bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c036060-349f-4a20-8518-ed315706393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c036060-349f-4a20-8518-ed315706393f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1974310797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94f75c1-26a5-4506-9cf8-6afee59f3827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aaf3f1062d4772913d6356a23be6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:22Z,use_quota=True,user_id='fbf7a59dab244c388a640fc11f3871d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed15c07a-15cf-4e99-ad4b-961d56896841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed15c07a-15cf-4e99-ad4b-961d56896841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bdfbe0-e974-4ffb-998f-2db729c9ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97bdfbe0-e974-4ffb-998f-2db729c9ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c94f75c1-26a5-4506-9cf8-6afee59f3827', 'volume_name': 'volume-c94f75c1-26a5-4506-9cf8-6afee59f3827', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7066dbf0-e729-47c3-b12d-0f85bd55f7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7066dbf0-e729-47c3-b12d-0f85bd55f7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2c285b-8344-4525-86bb-bd9db851de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:21 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Volume c94f75c1-26a5-4506-9cf8-6afee59f3827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c94f75c1-26a5-4506-9cf8-6afee59f3827', 'volume_size': 1} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1974310797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94f75c1-26a5-4506-9cf8-6afee59f3827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aaf3f1062d4772913d6356a23be6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:22Z,use_quota=True,user_id='fbf7a59dab244c388a640fc11f3871d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Creating volume c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:21 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:22 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 1073741824 Aug 03 09:18:22 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-922a7dbd-cd66-4033-94ab-89e54fbae663-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "cinder-922a7dbd-cd66-4033-94ab-89e54fbae663-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb23f2e5-5300-4b79-a3a0-e2e91d3bb04d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:22 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 1073741824" returned: 0 in 0.545s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:22 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 Aug 03 09:18:22 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:22 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:22 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:22 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.288s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:22 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663" returned: 0 in 0.456s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d2c285b-8344-4525-86bb-bd9db851de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94f75c1-26a5-4506-9cf8-6afee59f3827', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c0df9e-ad5c-43e1-96ca-4875ca9fe2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:22 devstack sudo[114909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663 Aug 03 09:18:22 devstack sudo[114909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:22 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Volume volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 (c94f75c1-26a5-4506-9cf8-6afee59f3827): created successfully Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c0df9e-ad5c-43e1-96ca-4875ca9fe2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:22 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Flow 'volume_create_manager' (c7b86528-2b78-4e0e-b29d-99f7c59e8bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2adc7c2a-0eb1-4bd1-ac44-ff34c43fcc04 tempest-SnapshotDependencyTests-686689075 None] Created volume successfully. Aug 03 09:18:23 devstack sudo[114909]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-922a7dbd-cd66-4033-94ab-89e54fbae663" returned: 0 in 0.249s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-922a7dbd-cd66-4033-94ab-89e54fbae663" released by "delete_volume" :: held 0.779s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Created reservations ['1fb8012a-c204-4176-bb04-8abb74dba4fa', 'a3e5468c-2f2b-4a13-9c27-d3e3a491bc2f', 'cd01f201-5c56-48dc-9327-0deb79c2c7d8', '43453e58-198f-4db9-a574-e2fc1c20150e'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:23 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:23 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:23 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.244s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:23 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a8b67df2-ad36-4f3e-9580-ef8a1efab0cd tempest-ProjectMemberTests-1055550634 None] Lock "cinder-922a7dbd-cd66-4033-94ab-89e54fbae663-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (29fec51e-43dc-4a7c-a828-d75e6f100f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:23 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1691d32-0141-465e-a0fc-30fbd033dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1691d32-0141-465e-a0fc-30fbd033dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352359061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f8ed4f-9539-443f-b259-cad38c5f1943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:24Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da6609f-ae21-421e-a9bc-ec12624c0867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da6609f-ae21-421e-a9bc-ec12624c0867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b791241b-aaad-4246-a106-21c500767054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b791241b-aaad-4246-a106-21c500767054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f8ed4f-9539-443f-b259-cad38c5f1943', 'volume_name': 'volume-37f8ed4f-9539-443f-b259-cad38c5f1943', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b8afa7-2405-4f11-9f86-9481929435fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b8afa7-2405-4f11-9f86-9481929435fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31389bd-7a82-4514-a951-5823dd2f52f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Volume 37f8ed4f-9539-443f-b259-cad38c5f1943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f8ed4f-9539-443f-b259-cad38c5f1943', 'volume_size': 1} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-352359061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f8ed4f-9539-443f-b259-cad38c5f1943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:24Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Creating volume 37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:24 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:24 devstack sudo[114915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 1073741824 Aug 03 09:18:24 devstack sudo[114915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:24 devstack sudo[114915]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 1073741824" returned: 0 in 0.485s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:24 devstack sudo[114921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 Aug 03 09:18:24 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:24 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.585s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e31389bd-7a82-4514-a951-5823dd2f52f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f8ed4f-9539-443f-b259-cad38c5f1943', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136558ff-9b90-46d6-b4de-78442f9aee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Creating offline snapshot 8e66b474-685a-4f95-96b3-69c56a25bf16 of volume c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:18:24 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Volume volume-37f8ed4f-9539-443f-b259-cad38c5f1943 (37f8ed4f-9539-443f-b259-cad38c5f1943): created successfully Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136558ff-9b90-46d6-b4de-78442f9aee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (29fec51e-43dc-4a7c-a828-d75e6f100f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b10652a-c11e-4d65-88a2-685a7414741a]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:24 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:24 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a989279b-ac58-473b-9252-f201ef4ebb2e tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:18:25 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:25 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:25 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.390s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:25 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 1G Aug 03 09:18:25 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:25 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 1G" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:25 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:25 devstack sudo[114935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:25 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:26 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.323s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 is being set with open permissions: ugo+rw Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:26 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:26 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:26 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.306s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:26 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info Aug 03 09:18:26 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:26 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info" returned: 0 in 0.283s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:26 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info is being set with open permissions: ugo+rw Aug 03 09:18:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:26 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info Aug 03 09:18:26 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:27 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.info" returned: 0 in 0.275s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.807s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot 4d8e29fd-005f-412e-860c-ffeefc78ec65 of volume 37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:18:27 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-84423cd1-6543-40a3-837c-6e2d19de2ba3 tempest-SnapshotDependencyTests-686689075 None] Create snapshot completed successfully Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f03cd46-0c5a-4d7b-a1fe-896b04256596]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:27 devstack sudo[114950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 Aug 03 09:18:27 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:27 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943" returned: 0 in 0.411s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:27 devstack sudo[114955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 1G Aug 03 09:18:27 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:28 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 1G" returned: 0 in 0.509s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f8ed4f-9539-443f-b259-cad38c5f1943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:28 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f8ed4f-9539-443f-b259-cad38c5f1943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 Aug 03 09:18:28 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Flow 'volume_create_manager' (9a0a44dd-e0b1-4426-94d5-aff3dc89e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bf6b1f-44cb-408f-9f82-e8c3dbed6ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76bf6b1f-44cb-408f-9f82-e8c3dbed6ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c32651b-31b9-468e-8fbe-f85ed405ef20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09aaf3f1062d4772913d6356a23be6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e66b474-685a-4f95-96b3-69c56a25bf16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:28Z,use_quota=True,user_id='fbf7a59dab244c388a640fc11f3871d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23935fa8-eda0-4a9d-8bdd-907c843aea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23935fa8-eda0-4a9d-8bdd-907c843aea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f19365-4c4d-42a9-b7a0-6b4e0e7061bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57f19365-4c4d-42a9-b7a0-6b4e0e7061bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c32651b-31b9-468e-8fbe-f85ed405ef20', 'volume_name': 'volume-0c32651b-31b9-468e-8fbe-f85ed405ef20', 'volume_size': 1, 'snapshot_id': '8e66b474-685a-4f95-96b3-69c56a25bf16'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30645a61-7be0-4446-9557-28abaf7e8d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30645a61-7be0-4446-9557-28abaf7e8d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b251c8dd-cec3-48ec-ac17-30c04e020f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:28 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Volume 0c32651b-31b9-468e-8fbe-f85ed405ef20: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c32651b-31b9-468e-8fbe-f85ed405ef20', 'volume_size': 1, 'snapshot_id': '8e66b474-685a-4f95-96b3-69c56a25bf16'} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:28 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f8ed4f-9539-443f-b259-cad38c5f1943 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65" returned: 0 in 0.327s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 is being set with open permissions: ugo+rw Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:28 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 Aug 03 09:18:28 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:28 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:28 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info Aug 03 09:18:28 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:28 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info" returned: 0 in 0.250s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:28 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info is being set with open permissions: ugo+rw Aug 03 09:18:28 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:28 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info Aug 03 09:18:28 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:29 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.info" returned: 0 in 0.265s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.898s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16-0c32651b-31b9-468e-8fbe-f85ed405ef20" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16-0c32651b-31b9-468e-8fbe-f85ed405ef20" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Creating volume 0c32651b-31b9-468e-8fbe-f85ed405ef20 from snapshot 8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:29 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-60113484-99ab-4f8a-a3f4-6757ac5af4f8 tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] snapshot: 8e66b474-685a-4f95-96b3-69c56a25bf16, volume: 0c32651b-31b9-468e-8fbe-f85ed405ef20, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37636b-26b0-4480-b096-fe3c43814a01]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:29 devstack sudo[114976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:29 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-4d8e29fd-005f-412e-860c-ffeefc78ec65-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-4d8e29fd-005f-412e-860c-ffeefc78ec65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-4d8e29fd-005f-412e-860c-ffeefc78ec65" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-4d8e29fd-005f-412e-860c-ffeefc78ec65" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot 4d8e29fd-005f-412e-860c-ffeefc78ec65 of volume 37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a0147e-273b-4db7-8581-faab7b2083cf]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:29 devstack sudo[114978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 Aug 03 09:18:29 devstack sudo[114978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:29 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.410s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94f75c1-26a5-4506-9cf8-6afee59f3827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2414d52-c672-4112-9525-bd4eb1877862]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:29 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:29 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:29 devstack sudo[114978]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37f8ed4f-9539-443f-b259-cad38c5f1943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0e7cf9-6d06-4962-88ce-c433d6bcf8fb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:29 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:30 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 Aug 03 09:18:30 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:30 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:30 devstack sudo[114993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 Aug 03 09:18:30 devstack sudo[114993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:30 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:30 devstack sudo[115000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 Aug 03 09:18:30 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:30 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65" returned: 0 in 0.535s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:30 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:30 devstack sudo[115013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65 Aug 03 09:18:30 devstack sudo[115013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:31 devstack sudo[115013]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:31 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943.4d8e29fd-005f-412e-860c-ffeefc78ec65" returned: 0 in 0.581s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-4d8e29fd-005f-412e-860c-ffeefc78ec65" released by "_delete_snapshot" :: held 2.034s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" released by "delete_snapshot" :: held 2.068s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:31 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Created reservations ['d2de087d-b2d3-48ff-a332-e17b17fd19c4', 'c0165844-8cea-4afd-8bb3-558e825af8ed', '0768345f-718f-45e2-aed6-a624dd4baf3e', 'fba7f743-e9f3-4b77-a049-86494df6c5e7'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:31 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:18:31 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-875eb685-2502-4103-9667-fa9b5881f1c4 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-4d8e29fd-005f-412e-860c-ffeefc78ec65-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-37f8ed4f-9539-443f-b259-cad38c5f1943-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-37f8ed4f-9539-443f-b259-cad38c5f1943-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" acquired by "delete_volume" :: waited 0.022s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:33 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d50ae52-0d40-42c8-b51f-e20e7dd45f28]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:33 devstack sudo[115017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 Aug 03 09:18:33 devstack sudo[115017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:33 devstack sudo[115017]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943" returned: 0 in 0.878s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:33 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:33 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943 Aug 03 09:18:33 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:34 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-37f8ed4f-9539-443f-b259-cad38c5f1943" returned: 0 in 0.546s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-37f8ed4f-9539-443f-b259-cad38c5f1943" released by "delete_volume" :: held 1.569s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Created reservations ['f0acb5c3-9c26-4d6a-956f-2d30cdb40f41', '9a41ccba-0012-4d1a-87fc-bdbcfb9e7187', 'f1bdf587-4cb8-4498-9890-545253dbcb6c', '6c2d2c21-d47b-4c57-ba0d-108a02bbe8e1'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:34 devstack sudo[114993]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20" returned: 0 in 4.489s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:18:34 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Converted 1024.00 MB image at 228.06 MB/s Aug 03 09:18:34 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 is being set with open permissions: ugo+rw Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:34 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 Aug 03 09:18:34 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:34 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:34 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:34 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" released by "_copy_volume_from_snapshot" :: held 5.651s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16-0c32651b-31b9-468e-8fbe-f85ed405ef20" released by "_create_volume_from_snapshot" :: held 5.724s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.750s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:34 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b251c8dd-cec3-48ec-ac17-30c04e020f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c32651b-31b9-468e-8fbe-f85ed405ef20', 'volume_size': 1, 'snapshot_id': '8e66b474-685a-4f95-96b3-69c56a25bf16'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdeeddc-a221-4869-a4a1-b2592065b2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-9d4b1c4e-4f06-4ade-8f0d-6add32fd25a5 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-37f8ed4f-9539-443f-b259-cad38c5f1943-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:34 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Volume volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 (0c32651b-31b9-468e-8fbe-f85ed405ef20): created successfully Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bdeeddc-a221-4869-a4a1-b2592065b2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Flow 'volume_create_manager' (9a0a44dd-e0b1-4426-94d5-aff3dc89e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:35 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-a0fd4bf4-d6da-42cc-a3a4-3f813385fc8a tempest-SnapshotDependencyTests-686689075 None] Created volume successfully. Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (2c1fdce3-8977-48ba-ac77-7c1d8b73178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f0448-053f-46af-98bf-5dc8588d3497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f0448-053f-46af-98bf-5dc8588d3497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112402797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f12a029-8e7d-4fac-ab0e-acecf8cae24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:36Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232ec5d7-ec18-4c59-9a31-73f7276fb3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232ec5d7-ec18-4c59-9a31-73f7276fb3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a433fe79-eaeb-4f5e-90ad-2131523873b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a433fe79-eaeb-4f5e-90ad-2131523873b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f12a029-8e7d-4fac-ab0e-acecf8cae24a', 'volume_name': 'volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d719308b-57cc-46ae-b749-896762bf264b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d719308b-57cc-46ae-b749-896762bf264b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d25f5a-ee53-4b55-bf94-1ad20ce182fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:35 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Volume 2f12a029-8e7d-4fac-ab0e-acecf8cae24a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a', 'volume_size': 1} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2112402797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f12a029-8e7d-4fac-ab0e-acecf8cae24a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5505940fe0452aa51bb93bba9e3c62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:18:36Z,use_quota=True,user_id='91d042d600094606923815408ba84567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Creating volume 2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:18:35 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:35 devstack sudo[115031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a 1073741824 Aug 03 09:18:35 devstack sudo[115031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-8e66b474-685a-4f95-96b3-69c56a25bf16-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-8e66b474-685a-4f95-96b3-69c56a25bf16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Deleting offline snapshot 8e66b474-685a-4f95-96b3-69c56a25bf16 of volume c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] snapshot_file for this snap is: volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[309a3a54-52ce-496a-8fba-277481ad82f9]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:36 devstack sudo[115036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:36 devstack sudo[115036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:36 devstack sudo[115031]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a 1073741824" returned: 0 in 0.451s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=151,cinder:UPDATE=202,cinder:INSERT=56,cinder:DELETE=17 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:36 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a Aug 03 09:18:36 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:36 devstack sudo[115036]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.444s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c94f75c1-26a5-4506-9cf8-6afee59f3827(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b522704f-3c33-4e4f-8924-cef5d72dab5d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:36 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" returned: 0 in 0.280s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d25f5a-ee53-4b55-bf94-1ad20ce182fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50ada39-68de-4a07-a420-4389ec888bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:18:36 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Volume volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a (2f12a029-8e7d-4fac-ab0e-acecf8cae24a): created successfully Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50ada39-68de-4a07-a420-4389ec888bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Flow 'volume_create_manager' (2c1fdce3-8977-48ba-ac77-7c1d8b73178e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:18:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-56393d95-4999-4092-a69c-063d6f621212 tempest-ProjectMemberTests-1055550634 None] Created volume successfully. Aug 03 09:18:36 devstack sudo[115045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:36 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Creating offline snapshot a7b447e8-3283-4148-8eb0-9f6cb5bfd236 of volume 2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b17d34-c364-4ab2-91b6-b7e4bd58725e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:36 devstack sudo[115049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a Aug 03 09:18:36 devstack sudo[115049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:36 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.568s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:37 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:37 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:37 devstack sudo[115049]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" returned: 0 in 0.378s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:37 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 1G Aug 03 09:18:37 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:37 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:37 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16 Aug 03 09:18:37 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:37 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 1G" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:37 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827.8e66b474-685a-4f95-96b3-69c56a25bf16" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:37 devstack sudo[115068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 Aug 03 09:18:37 devstack sudo[115068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-8e66b474-685a-4f95-96b3-69c56a25bf16" released by "_delete_snapshot" :: held 1.740s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" released by "delete_snapshot" :: held 1.761s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Created reservations ['d5f12535-e213-4665-9539-7ef471f50b8e', 'f017d35a-d0de-456d-bf24-be96328be8d1', 'b61fc08a-209f-493a-9c16-f489939bab71', 'c3d0dbab-c2ef-4f86-83d5-27ae7fd25530'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:37 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Delete snapshot completed successfully. Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f496d374-99c3-4b19-b446-e91d2b8e5f92 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-8e66b474-685a-4f95-96b3-69c56a25bf16-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:37 devstack sudo[115068]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236" returned: 0 in 0.308s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:37 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 is being set with open permissions: ugo+rw Aug 03 09:18:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:37 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 Aug 03 09:18:37 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-c94f75c1-26a5-4506-9cf8-6afee59f3827-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-c94f75c1-26a5-4506-9cf8-6afee59f3827-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:38 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c059d6a-10c1-4393-b1f3-3ba25f0cc37c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236" returned: 0 in 0.276s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:38 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info Aug 03 09:18:38 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:38 devstack sudo[115076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:38 devstack sudo[115076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:38 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:38 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info is being set with open permissions: ugo+rw Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:38 devstack sudo[115085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info Aug 03 09:18:38 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:38 devstack sudo[115076]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.362s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:38 devstack sudo[115087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827 Aug 03 09:18:38 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:38 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.info" returned: 0 in 0.258s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-dab5cf04-22d3-4060-a7d3-be7b4106de1a tempest-ProjectMemberTests-1055550634 None] Create snapshot completed successfully Aug 03 09:18:38 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c94f75c1-26a5-4506-9cf8-6afee59f3827" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-c94f75c1-26a5-4506-9cf8-6afee59f3827" released by "delete_volume" :: held 0.692s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Created reservations ['bbf29312-8819-4f41-b4a9-623b866f2304', '4909dcf2-6aa0-4958-85dc-6a2b678cb756', 'e964756e-332e-4c45-a84e-0d9bff612a19', '50199b1b-36cf-4d1b-87d3-14b3b525c4aa'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:38 devstack sudo[115092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:38 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-a7b447e8-3283-4148-8eb0-9f6cb5bfd236-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-a7b447e8-3283-4148-8eb0-9f6cb5bfd236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-a7b447e8-3283-4148-8eb0-9f6cb5bfd236" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-a7b447e8-3283-4148-8eb0-9f6cb5bfd236" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Deleting offline snapshot a7b447e8-3283-4148-8eb0-9f6cb5bfd236 of volume 2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] snapshot_file for this snap is: volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[194eaaa4-8dfe-4027-8287-1e7117a20d18]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:39 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-0c32651b-31b9-468e-8fbe-f85ed405ef20-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:39 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Deleted volume successfully. Aug 03 09:18:39 devstack sudo[115094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 Aug 03 09:18:39 devstack sudo[115094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-0c32651b-31b9-468e-8fbe-f85ed405ef20-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-815a1dff-6b32-41dd-a06e-546d4cb350e6 tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-c94f75c1-26a5-4506-9cf8-6afee59f3827-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f975fb-3182-494a-b990-607e2bc31be3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:39 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 Aug 03 09:18:39 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:39 devstack sudo[115094]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236" returned: 0 in 0.424s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16e9f8c-16cc-49f9-a5aa-7b8837d6afde]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:39 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a Aug 03 09:18:39 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:39 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20" returned: 0 in 0.386s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:39 devstack sudo[115107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20 Aug 03 09:18:39 devstack sudo[115107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:39 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:39 devstack sudo[115112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 Aug 03 09:18:39 devstack sudo[115112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:40 devstack sudo[115107]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0c32651b-31b9-468e-8fbe-f85ed405ef20" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-quobyte-0c32651b-31b9-468e-8fbe-f85ed405ef20" released by "delete_volume" :: held 0.687s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Created reservations ['cc1abf50-3a45-49b2-95dc-f65ca0d11732', 'd793d7e3-f186-4617-9310-c7721323a727', 'b2dc5441-92ac-468e-b4ba-bdc5c52122fb', 'e58a1b2a-83d7-4c8b-992e-f3f00685ada4'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:40 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:40 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:40 devstack sudo[115112]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:40 devstack sudo[115120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236 Aug 03 09:18:40 devstack sudo[115120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:40 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.271s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Deleted volume successfully. Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1fba6c93-4de8-4b20-a073-d2e7b73a59ad tempest-SnapshotDependencyTests-686689075 None] Lock "cinder-0c32651b-31b9-468e-8fbe-f85ed405ef20-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:40 devstack sudo[115120]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a.a7b447e8-3283-4148-8eb0-9f6cb5bfd236" returned: 0 in 0.295s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-a7b447e8-3283-4148-8eb0-9f6cb5bfd236" released by "_delete_snapshot" :: held 1.536s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" released by "delete_snapshot" :: held 1.559s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Created reservations ['ba3177f8-7e33-4377-9100-78012f1b9118', '484f0134-b1c1-4a77-b76c-b91976be502d', '656d9596-19e5-450a-a8fe-61fa71744750', '223caa24-832e-4520-9dc5-7402bbd96ed3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:40 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Delete snapshot completed successfully. Aug 03 09:18:40 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e544e8e6-2961-4e9c-90f0-6bb79aaba15b tempest-ProjectMemberTests-1055550634 None] Lock "cinder-a7b447e8-3283-4148-8eb0-9f6cb5bfd236-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-2f12a029-8e7d-4fac-ab0e-acecf8cae24a-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-2f12a029-8e7d-4fac-ab0e-acecf8cae24a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[52022985-087e-472b-8129-cb83ee41c7db]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:41 devstack sudo[115124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a Aug 03 09:18:41 devstack sudo[115124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:41 devstack sudo[115124]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:41 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:41 devstack sudo[115129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a Aug 03 09:18:41 devstack sudo[115129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:42 devstack sudo[115129]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" returned: 0 in 0.307s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-quobyte-2f12a029-8e7d-4fac-ab0e-acecf8cae24a" released by "delete_volume" :: held 0.753s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Created reservations ['6683a6a0-234d-4501-8aa4-ccefa56015f7', '22da4aaa-21b8-44c9-b9c8-5c63bd068e6b', 'bec20db8-4197-4875-a908-b7ff8b501fe4', 'd76737c8-b190-492d-a01d-0fcbace727b3'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:18:42 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:18:42 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:18:42 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.299s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:18:42 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Deleted volume successfully. Aug 03 09:18:42 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c8c808fc-0965-4e72-86a1-68c9b285cf32 tempest-ProjectMemberTests-1055550634 None] Lock "cinder-2f12a029-8e7d-4fac-ab0e-acecf8cae24a-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:18:52 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=38,cinder:SELECT=30,cinder:INSERT=8 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:18:52 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=150,cinder:INSERT=53,cinder:UPDATE=213,cinder:DELETE=20 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:08 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:19:08 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:09 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.231s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:19:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:19:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:19:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (f10c0c01-0429-436a-b357-464660b87f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c653a2-3eb5-4217-b8e6-301e96552276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9c653a2-3eb5-4217-b8e6-301e96552276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987588120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b47a6c-f5c5-49b2-9253-e9bb89e3172a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:19:51Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2214e808-eae8-4b78-8df9-2f837aae1dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2214e808-eae8-4b78-8df9-2f837aae1dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c1dd6f-00ca-42eb-88d9-3077db98d088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c1dd6f-00ca-42eb-88d9-3077db98d088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b47a6c-f5c5-49b2-9253-e9bb89e3172a', 'volume_name': 'volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9cd42-cf1c-4cd2-aad2-8eed69b8bdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea9cd42-cf1c-4cd2-aad2-8eed69b8bdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3def984-9471-46d6-b708-af6c8297e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Volume b6b47a6c-f5c5-49b2-9253-e9bb89e3172a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a', 'volume_size': 1} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987588120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b47a6c-f5c5-49b2-9253-e9bb89e3172a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:19:51Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Creating volume b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:19:51 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:51 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a 1073741824 Aug 03 09:19:51 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:51 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a 1073741824" returned: 0 in 0.420s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:51 devstack sudo[115241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a Aug 03 09:19:51 devstack sudo[115241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:51 devstack sudo[115241]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3def984-9471-46d6-b708-af6c8297e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf40d85-f499-426a-a442-3abecdbc0af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:51 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Volume volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a (b6b47a6c-f5c5-49b2-9253-e9bb89e3172a): created successfully Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf40d85-f499-426a-a442-3abecdbc0af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:51 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (f10c0c01-0429-436a-b357-464660b87f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:19:51 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-0102d0ac-d570-413f-b900-73b3cf6ff8d6 tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 23179e4d-44a4-4502-b62f-67b8af927fa9 of volume b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a77b77a-0339-4735-ba8b-4187e95d8e15]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:52 devstack sudo[115244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a Aug 03 09:19:52 devstack sudo[115244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:52 devstack sudo[115244]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:52 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 1G Aug 03 09:19:52 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:52 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 1G" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:52 devstack sudo[115260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 Aug 03 09:19:52 devstack sudo[115260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:53 devstack sudo[115260]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9" returned: 0 in 0.269s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:53 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 is being set with open permissions: ugo+rw Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:53 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 Aug 03 09:19:53 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:53 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:53 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info Aug 03 09:19:53 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:53 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:53 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info is being set with open permissions: ugo+rw Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:53 devstack sudo[115271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info Aug 03 09:19:53 devstack sudo[115271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:53 devstack sudo[115271]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.info" returned: 0 in 0.234s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8dd098df-1f6a-4ccc-b296-6e8f22216344 tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-23179e4d-44a4-4502-b62f-67b8af927fa9-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-23179e4d-44a4-4502-b62f-67b8af927fa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-23179e4d-44a4-4502-b62f-67b8af927fa9" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-23179e4d-44a4-4502-b62f-67b8af927fa9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Deleting offline snapshot 23179e4d-44a4-4502-b62f-67b8af927fa9 of volume b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] snapshot_file for this snap is: volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b14f7bd-8c2f-4409-8740-43b101c8d3e6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:54 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 Aug 03 09:19:54 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:54 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b7e6dd-53c4-46a9-b429-ff3e9ef7b326]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:19:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:54 devstack sudo[115279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a Aug 03 09:19:54 devstack sudo[115279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:55 devstack sudo[115279]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" returned: 0 in 0.339s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:55 devstack sudo[115284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 Aug 03 09:19:55 devstack sudo[115284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:55 devstack sudo[115284]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9" returned: 0 in 0.324s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:55 devstack sudo[115289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9 Aug 03 09:19:55 devstack sudo[115289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:55 devstack sudo[115289]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a.23179e4d-44a4-4502-b62f-67b8af927fa9" returned: 0 in 0.228s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-23179e4d-44a4-4502-b62f-67b8af927fa9" released by "_delete_snapshot" :: held 1.317s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" released by "delete_snapshot" :: held 1.339s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Created reservations ['1a1eefa7-289f-40f4-b310-e4882bc48c9b', '70991c8a-422a-4a3b-99a2-12ae5f7a25e8', '18185913-e718-43d2-afba-e77b5cd9edc7', '50672ac8-8022-4fd5-9b8f-9e81837ad089'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:19:55 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Delete snapshot completed successfully. Aug 03 09:19:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-7cdb3b3b-21e2-4d8d-9846-a236faf6e943 tempest-ProjectReaderTests-7839902 None] Lock "cinder-23179e4d-44a4-4502-b62f-67b8af927fa9-delete_snapshot" released by "delete_snapshot" :: held 1.464s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "cinder-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" acquired by "delete_volume" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858163e-3d9c-4831-9d40-d0fa22eb1283]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:56 devstack sudo[115292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a Aug 03 09:19:56 devstack sudo[115292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:56 devstack sudo[115292]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" returned: 0 in 0.341s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:56 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a Aug 03 09:19:56 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:57 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a" released by "delete_volume" :: held 0.634s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Created reservations ['37b2ce6d-9fab-469f-9a7a-0f325ee3f3be', '8c1cb005-dd00-4d60-a6a3-dbe84c91d703', '1781dae4-088f-4222-8cc4-ac4e343a1f55', '3a7706c6-72f1-4408-81a0-cadf75125c95'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:57 devstack sudo[115300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:19:57 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:57 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.229s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:19:57 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Deleted volume successfully. Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-c04890ab-3fd9-4dd6-bb10-f4d4112b3ff5 tempest-ProjectReaderTests-7839902 None] Lock "cinder-b6b47a6c-f5c5-49b2-9253-e9bb89e3172a-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:19:57 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (51ca3879-823c-4eaf-9abf-d2d8245e788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6629a8b9-733d-449e-96a2-936bfdc433d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6629a8b9-733d-449e-96a2-936bfdc433d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15343830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01306124-2656-47d7-b76b-e088b81f6c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:19:58Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415cf8ef-8442-4cbd-80e9-1a800e6fc4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415cf8ef-8442-4cbd-80e9-1a800e6fc4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260ce1a-4457-49d4-ad9e-57168afdbfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d260ce1a-4457-49d4-ad9e-57168afdbfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01306124-2656-47d7-b76b-e088b81f6c78', 'volume_name': 'volume-01306124-2656-47d7-b76b-e088b81f6c78', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9610c0-2d82-4971-9825-9ea3f57fd0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9610c0-2d82-4971-9825-9ea3f57fd0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caa6367-7f60-4e8f-a592-4d202c89fadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Volume 01306124-2656-47d7-b76b-e088b81f6c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01306124-2656-47d7-b76b-e088b81f6c78', 'volume_size': 1} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15343830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01306124-2656-47d7-b76b-e088b81f6c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:19:58Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Creating volume 01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:19:58 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:58 devstack sudo[115303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 1073741824 Aug 03 09:19:58 devstack sudo[115303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:58 devstack sudo[115303]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 1073741824" returned: 0 in 0.412s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:58 devstack sudo[115309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 Aug 03 09:19:58 devstack sudo[115309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:58 devstack sudo[115309]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3caa6367-7f60-4e8f-a592-4d202c89fadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01306124-2656-47d7-b76b-e088b81f6c78', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764d8d52-34ee-4efe-bd03-1b676d595436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:19:58 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Volume volume-01306124-2656-47d7-b76b-e088b81f6c78 (01306124-2656-47d7-b76b-e088b81f6c78): created successfully Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764d8d52-34ee-4efe-bd03-1b676d595436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:19:58 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (51ca3879-823c-4eaf-9abf-d2d8245e788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:19:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1fe5ce5a-1560-4ecd-8813-1f11444c77e9 tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 92012b7b-6b6b-48b0-8082-81202184246a of volume 01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ff6b1-6463-420a-9737-d2d47173ca45]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:59 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 Aug 03 09:19:59 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:59 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:59 devstack sudo[115318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a 1G Aug 03 09:19:59 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:19:59 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a 1G" returned: 0 in 0.375s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:19:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01306124-2656-47d7-b76b-e088b81f6c78 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:19:59 devstack sudo[115324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01306124-2656-47d7-b76b-e088b81f6c78 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a Aug 03 09:19:59 devstack sudo[115324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:00 devstack sudo[115324]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01306124-2656-47d7-b76b-e088b81f6c78 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a" returned: 0 in 0.273s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:00 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a is being set with open permissions: ugo+rw Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:00 devstack sudo[115329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a Aug 03 09:20:00 devstack sudo[115329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:00 devstack sudo[115329]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:00 devstack sudo[115332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info Aug 03 09:20:00 devstack sudo[115332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:00 devstack sudo[115332]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info" returned: 0 in 0.248s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:00 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info is being set with open permissions: ugo+rw Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:00 devstack sudo[115335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info Aug 03 09:20:00 devstack sudo[115335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:00 devstack sudo[115335]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.info" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.790s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ebdc55e9-0c03-4dc7-a224-f68d30694a6e tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-92012b7b-6b6b-48b0-8082-81202184246a-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-92012b7b-6b6b-48b0-8082-81202184246a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-92012b7b-6b6b-48b0-8082-81202184246a" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-92012b7b-6b6b-48b0-8082-81202184246a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Deleting offline snapshot 92012b7b-6b6b-48b0-8082-81202184246a of volume 01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] snapshot_file for this snap is: volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0e920f-d358-49cb-9026-fb6b2c2cc350]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:01 devstack sudo[115340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a Aug 03 09:20:01 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:01 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a" returned: 0 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01306124-2656-47d7-b76b-e088b81f6c78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f0e725-f00b-4577-b7a3-b565e77e461f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:01 devstack sudo[115345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 Aug 03 09:20:01 devstack sudo[115345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:02 devstack sudo[115345]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78" returned: 0 in 0.343s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:02 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a Aug 03 09:20:02 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:02 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a" returned: 0 in 0.319s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:02 devstack sudo[115355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a Aug 03 09:20:02 devstack sudo[115355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:02 devstack sudo[115355]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78.92012b7b-6b6b-48b0-8082-81202184246a" returned: 0 in 0.229s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-92012b7b-6b6b-48b0-8082-81202184246a" released by "_delete_snapshot" :: held 1.319s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" released by "delete_snapshot" :: held 1.340s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Created reservations ['d21018cc-6a9c-44ab-a943-7ce8609b49a2', '98dc06f7-1dca-47c1-b06c-a414486308f5', 'b3c10352-1883-4182-a557-28e6efaf7ff2', 'fc9d5b3a-e3e0-4284-9e64-58f380e2e0db'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:20:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Delete snapshot completed successfully. Aug 03 09:20:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-1465a81e-0eec-4c20-a36d-e5d1ae2d2dab tempest-ProjectReaderTests-7839902 None] Lock "cinder-92012b7b-6b6b-48b0-8082-81202184246a-delete_snapshot" released by "delete_snapshot" :: held 1.460s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-01306124-2656-47d7-b76b-e088b81f6c78-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "cinder-01306124-2656-47d7-b76b-e088b81f6c78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8605fd59-2bc0-48ca-a6df-4bf2f6d398ec]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:03 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 Aug 03 09:20:03 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:03 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78" returned: 0 in 0.342s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:03 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:03 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78 Aug 03 09:20:03 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:04 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-01306124-2656-47d7-b76b-e088b81f6c78" returned: 0 in 0.229s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-01306124-2656-47d7-b76b-e088b81f6c78" released by "delete_volume" :: held 0.625s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Created reservations ['4f101c95-938a-43ec-878d-569bd3f3c96c', '4cc875d6-af05-4cc2-88e0-1be5f0ee20b8', '5a1537e9-3741-4317-946b-fb272ab7f3c1', '21a8d76c-27d0-416c-a3f0-a6468f080eb6'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:04 devstack sudo[115367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:20:04 devstack sudo[115367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:04 devstack sudo[115367]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.232s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:20:04 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Deleted volume successfully. Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-390a63c8-cb82-4cf8-be3f-2be62c499656 tempest-ProjectReaderTests-7839902 None] Lock "cinder-01306124-2656-47d7-b76b-e088b81f6c78-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:04 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (3d51c28f-16d8-4ab5-a36f-acd852139457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47c2f96-5e0a-4738-9e68-4535cfe1ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a47c2f96-5e0a-4738-9e68-4535cfe1ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243380266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0608e5af-fb2f-4b55-abc1-5daf1c9eb05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:20:05Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11585044-7bd3-4f50-84dc-2a044789d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11585044-7bd3-4f50-84dc-2a044789d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c097b6a-a1b7-472a-a796-92ec01d2950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c097b6a-a1b7-472a-a796-92ec01d2950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0608e5af-fb2f-4b55-abc1-5daf1c9eb05a', 'volume_name': 'volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd78211-5ece-49e9-b8ad-49b48b9f48f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd78211-5ece-49e9-b8ad-49b48b9f48f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855505a6-4162-4fe8-b0fe-9f8e6a5d6c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Volume 0608e5af-fb2f-4b55-abc1-5daf1c9eb05a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a', 'volume_size': 1} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1243380266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0608e5af-fb2f-4b55-abc1-5daf1c9eb05a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f390a6ed4bf4e81a5d93b75519b6ced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:20:05Z,use_quota=True,user_id='3b143cc9985d4688bf84ae17b6a9d3de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Creating volume 0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:20:05 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:05 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a 1073741824 Aug 03 09:20:05 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:05 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a 1073741824" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:05 devstack sudo[115376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a Aug 03 09:20:05 devstack sudo[115376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:05 devstack sudo[115376]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (855505a6-4162-4fe8-b0fe-9f8e6a5d6c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3320b2-01b1-4b94-bb08-c0a193f135e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:20:05 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Volume volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a (0608e5af-fb2f-4b55-abc1-5daf1c9eb05a): created successfully Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3320b2-01b1-4b94-bb08-c0a193f135e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:20:05 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Flow 'volume_create_manager' (3d51c28f-16d8-4ab5-a36f-acd852139457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:20:05 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-1e6ae7bd-8009-494e-9f5c-00af64224486 tempest-ProjectReaderTests-7839902 None] Created volume successfully. Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Creating offline snapshot 982dfe72-daf9-4167-8344-f4b547c7e3c0 of volume 0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e138ea3a-2244-4e4e-a393-40e028e7e5c6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:06 devstack sudo[115379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a Aug 03 09:20:06 devstack sudo[115379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:06 devstack sudo[115379]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:06 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 1G Aug 03 09:20:06 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:06 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 1G" returned: 0 in 0.387s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:06 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:06 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 Aug 03 09:20:06 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:07 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0" returned: 0 in 0.297s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:07 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 is being set with open permissions: ugo+rw Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:07 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 Aug 03 09:20:07 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:07 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0" returned: 0 in 0.228s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:07 devstack sudo[115397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info Aug 03 09:20:07 devstack sudo[115397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:07 devstack sudo[115397]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:07 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info is being set with open permissions: ugo+rw Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:07 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info Aug 03 09:20:07 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:07 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.info" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:07 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:08 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-21a9d957-cce0-441c-9d07-b413dfec3dcd tempest-ProjectReaderTests-7839902 None] Create snapshot completed successfully Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-982dfe72-daf9-4167-8344-f4b547c7e3c0-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-982dfe72-daf9-4167-8344-f4b547c7e3c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" acquired by "delete_snapshot" :: waited 0.012s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-982dfe72-daf9-4167-8344-f4b547c7e3c0" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-982dfe72-daf9-4167-8344-f4b547c7e3c0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Deleting offline snapshot 982dfe72-daf9-4167-8344-f4b547c7e3c0 of volume 0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] snapshot_file for this snap is: volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7762f6a-c23b-4db2-8414-0c84698d1a87]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:08 devstack sudo[115403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 Aug 03 09:20:08 devstack sudo[115403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:08 devstack sudo[115403]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0" returned: 0 in 0.351s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f28953-1f62-43a5-9441-2c60f7b604e8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:08 devstack sudo[115409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:20:08 devstack sudo[115409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:08 devstack sudo[115408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a Aug 03 09:20:08 devstack sudo[115408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:09 devstack sudo[115409]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.250s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:20:09 devstack sudo[115408]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:09 devstack sudo[115417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 Aug 03 09:20:09 devstack sudo[115417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:09 devstack sudo[115417]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0" returned: 0 in 0.335s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:09 devstack sudo[115427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0 Aug 03 09:20:09 devstack sudo[115427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:09 devstack sudo[115427]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a.982dfe72-daf9-4167-8344-f4b547c7e3c0" returned: 0 in 0.254s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-982dfe72-daf9-4167-8344-f4b547c7e3c0" released by "_delete_snapshot" :: held 1.395s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" released by "delete_snapshot" :: held 1.417s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Created reservations ['b0857408-a14c-405d-bb49-1ccdf59a129a', 'f83f4402-f667-4dfb-b235-1522cde685fb', 'c1e7e9a8-8ca6-4cd3-a0cf-56b052b1441c', '748c1ec1-9e71-476c-acf8-a39d432e193c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:20:09 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Delete snapshot completed successfully. Aug 03 09:20:09 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-75584b76-2f29-42c5-a4a2-5335acbd8328 tempest-ProjectReaderTests-7839902 None] Lock "cinder-982dfe72-daf9-4167-8344-f4b547c7e3c0-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "cinder-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Acquiring lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" acquired by "delete_volume" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c341376-99ff-45d8-9573-eb281743768f]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:10 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a Aug 03 09:20:10 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:10 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" returned: 0 in 0.358s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:10 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:10 devstack sudo[115435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a Aug 03 09:20:10 devstack sudo[115435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:11 devstack sudo[115435]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" returned: 0 in 0.240s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "cinder-quobyte-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a" released by "delete_volume" :: held 0.653s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Created reservations ['c0318589-fac2-445a-8963-e518db820088', 'b78f2144-38a8-435a-a5c3-499e1aea601a', '1d0b1e74-af79-4e2c-bacf-85613730ba7e', 'fd39a726-e25b-4055-90e4-5c40ff56cc80'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:20:11 devstack sudo[115438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:20:11 devstack sudo[115438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:20:11 devstack sudo[115438]: pam_unix(sudo:session): session closed for user root Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:20:11 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Deleted volume successfully. Aug 03 09:20:11 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-ac51c5cc-f1e7-4dd0-841d-5aecd60f0f0c tempest-ProjectReaderTests-7839902 None] Lock "cinder-0608e5af-fb2f-4b55-abc1-5daf1c9eb05a-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:20:21 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=58,cinder:SELECT=38,cinder:INSERT=13,cinder:DELETE=6 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:20:30 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=47,cinder:INSERT=17,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:08 devstack sudo[115617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:21:08 devstack sudo[115617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:09 devstack sudo[115617]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:21:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:21:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:21:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:21:13 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:21:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (a0a7e7b2-8b46-47c6-9ab3-5351569ed7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:21:13 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf0b150-d1b5-4bea-8fe5-29f32f87ecad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf0b150-d1b5-4bea-8fe5-29f32f87ecad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1441713031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9cd78d1c14e63824ad10ae05b3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:21:14Z,use_quota=True,user_id='9c1556bf8c8e46ef9cef748a65024371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8c5ec4-3224-47b0-876c-e3dfe6c90206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8c5ec4-3224-47b0-876c-e3dfe6c90206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fcf912-3189-47a0-b8cd-9f6c0ff6eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10fcf912-3189-47a0-b8cd-9f6c0ff6eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f', 'volume_name': 'volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8889c5-9e1d-48f5-9742-0472da2fed57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a8889c5-9e1d-48f5-9742-0472da2fed57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a289a-bfba-492b-a9f1-c193625300ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f', 'volume_size': 1} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1441713031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9cd78d1c14e63824ad10ae05b3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:21:14Z,use_quota=True,user_id='9c1556bf8c8e46ef9cef748a65024371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)}" {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Creating volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:21:14 devstack cinder-volume[88796]: INFO cinder.volume.drivers.remotefs [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] casted to osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f 1073741824 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:14 devstack sudo[115623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f 1073741824 Aug 03 09:21:14 devstack sudo[115623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:14 devstack sudo[115623]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f 1073741824" returned: 0 in 0.395s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:14 devstack sudo[115628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:21:14 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:14 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.234s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'} {{(pid=88796) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31a289a-bfba-492b-a9f1-c193625300ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f', 'volume_size': 1}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566b755-5fa5-4a35-a016-bb670a7d262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:21:14 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Volume volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f (8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f): created successfully Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5566b755-5fa5-4a35-a016-bb670a7d262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:21:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (a0a7e7b2-8b46-47c6-9ab3-5351569ed7a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:21:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-9e07b3f2-f6f9-4875-aa95-5e1758d72e4e tempest-SnapshotDataIntegrityTests-1514407722 None] Created volume successfully. Aug 03 09:21:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-37d040b1-23a5-494a-aff1-ccda19c8b988 req-e82dace8-a5ce-475b-be4a-f711dc9d9dc2 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-37d040b1-23a5-494a-aff1-ccda19c8b988 req-e82dace8-a5ce-475b-be4a-f711dc9d9dc2 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-37d040b1-23a5-494a-aff1-ccda19c8b988 req-e82dace8-a5ce-475b-be4a-f711dc9d9dc2 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:16 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-37d040b1-23a5-494a-aff1-ccda19c8b988 req-e82dace8-a5ce-475b-be4a-f711dc9d9dc2 tempest-SnapshotDataIntegrityTests-1514407722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ee75073-b833-4bed-9dbb-02de3fd14559', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:21:16 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-37d040b1-23a5-494a-aff1-ccda19c8b988 req-e82dace8-a5ce-475b-be4a-f711dc9d9dc2 tempest-SnapshotDataIntegrityTests-1514407722 None] attachment_update completed successfully. Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating online snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87dc223-3d91-4834-a447-00ad21f4bab5]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:19 devstack sudo[116060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:21:19 devstack sudo[116060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:19 devstack sudo[116060]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:19 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:19 devstack sudo[116065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 1G Aug 03 09:21:19 devstack sudo[116065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:20 devstack sudo[116065]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 1G" returned: 0 in 0.366s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:20 devstack sudo[116071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:21:20 devstack sudo[116071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:20 devstack sudo[116071]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.274s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 is being set with open permissions: ugo+rw Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:20 devstack sudo[116077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:21:20 devstack sudo[116077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:20 devstack sudo[116077]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.229s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}624fe5ac32518760be3be7825a9ee697045c6a280a934ec3662298405945ac94" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37ff08d9-db50-499d-9e59-334c30c07790" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f", "create_info": {"type": "qcow2", "new_file": "volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21", "snapshot_id": "9fabc701-a6fa-475e-b820-80b24aa73d21"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:21:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-35f9c587-d02e-4d91-b6c7-018f19f949ec x-openstack-request-id: req-35f9c587-d02e-4d91-b6c7-018f19f949ec {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-35f9c587-d02e-4d91-b6c7-018f19f949ec {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:21:20 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:21 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:22 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:23 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:24 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:25 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:28 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:29 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:30 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:31 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:33 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:35 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:35 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:35 devstack sudo[116088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info Aug 03 09:21:35 devstack sudo[116088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:36 devstack sudo[116088]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info" returned: 0 in 0.257s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:36 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info is being set with open permissions: ugo+rw Aug 03 09:21:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:36 devstack sudo[116091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info Aug 03 09:21:36 devstack sudo[116091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:36 devstack sudo[116091]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.info" returned: 0 in 0.243s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:36 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 17.190s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:36 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-37ff08d9-db50-499d-9e59-334c30c07790 tempest-SnapshotDataIntegrityTests-1514407722 None] Create snapshot completed successfully Aug 03 09:21:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:37 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating online snapshot e84acc5f-62ee-4bfb-a019-c1143428457f of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:21:37 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8230ee2-7393-4aa4-a8ae-22fae585166c]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:21:37 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:37 devstack sudo[116128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:21:37 devstack sudo[116128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:38 devstack sudo[116128]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:38 devstack sudo[116133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f 1G Aug 03 09:21:38 devstack sudo[116133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:38 devstack sudo[116133]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f 1G" returned: 0 in 0.399s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:38 devstack sudo[116138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:21:38 devstack sudo[116138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:38 devstack sudo[116138]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.281s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:38 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f is being set with open permissions: ugo+rw Aug 03 09:21:38 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:38 devstack sudo[116143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:21:38 devstack sudo[116143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:39 devstack sudo[116143]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.238s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}aebd9e0a6c90787bc1558ed676054c8324c3dbc14ac099580e4930ec8661dec7" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-514155b8-e2e7-4123-a73c-0b991c94bef5" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f", "create_info": {"type": "qcow2", "new_file": "volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f", "snapshot_id": "e84acc5f-62ee-4bfb-a019-c1143428457f"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:21:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9972602d-a8af-4aa8-af6e-21c1eff7d617 x-openstack-request-id: req-9972602d-a8af-4aa8-af6e-21c1eff7d617 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-9972602d-a8af-4aa8-af6e-21c1eff7d617 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:21:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:41 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:42 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:43 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:44 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:45 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:46 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:47 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:48 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:49 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:50 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot e84acc5f-62ee-4bfb-a019-c1143428457f is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 16.681s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:21:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-514155b8-e2e7-4123-a73c-0b991c94bef5 tempest-SnapshotDataIntegrityTests-1514407722 None] Create snapshot completed successfully Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating online snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6f35f8-7fb0-4fe9-b3d3-d1a03151b34e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:56 devstack sudo[116214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:21:56 devstack sudo[116214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:56 devstack sudo[116214]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 1G {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:56 devstack sudo[116219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 1G Aug 03 09:21:56 devstack sudo[116219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:56 devstack sudo[116219]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 1G" returned: 0 in 0.429s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:57 devstack sudo[116224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:21:57 devstack sudo[116224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:57 devstack sudo[116224]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f -F qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.272s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:57 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 is being set with open permissions: ugo+rw Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:21:57 devstack sudo[116229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:21:57 devstack sudo[116229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:21:57 devstack sudo[116229]: pam_unix(sudo:session): session closed for user root Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.232s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG cinder.compute.nova [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating Keystone auth plugin from conf {{(pid=88796) novaclient /opt/stack/cinder/cinder/compute/nova.py:99}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] REQ: curl -g -i -X POST http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}94dcf5ebde2e89d5992051b72e316bc1c66ba3ba331553eabf7a1ff4cc8ef15c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1478218-0d06-4e90-a45d-dee09b846381" -H "X-Service-Token: {SHA256}300e445e579bce9e37e2d8428c0ffb4fdd89a21a25df06accb2653ef3321a1e0" -d '{"snapshot": {"volume_id": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f", "create_info": {"type": "qcow2", "new_file": "volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37", "snapshot_id": "d5991035-2a4f-4fbe-83c0-50c6a6136b37"}}}' {{(pid=88796) _http_log_request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:575}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP: [200] Connection: close Content-Length: 78 Content-Type: application/json Date: Mon, 03 Aug 2026 07:21:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.58 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d096bfec-1904-4d9a-afd1-404fa9b8b1f6 x-openstack-request-id: req-d096bfec-1904-4d9a-afd1-404fa9b8b1f6 {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:616}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] RESP BODY: {"snapshot": {"id": null, "volumeId": "8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f"}} {{(pid=88796) _http_log_response /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:651}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG novaclient.v2.client [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] POST call to compute for http://192.168.122.52/compute/v2.1/os-assisted-volume-snapshots used request id req-d096bfec-1904-4d9a-afd1-404fa9b8b1f6 {{(pid=88796) request /opt/stack/data/venv/lib/python3.12/site-packages/keystoneauth1/session.py:1076}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] nova call result: None {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1910}} Aug 03 09:21:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:58 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:21:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:00 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:01 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:03 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:04 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:05 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:06 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:07 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:08 devstack sudo[116241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:22:08 devstack sudo[116241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:09 devstack sudo[116241]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.237s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:22:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:22:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:22:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:22:10 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=9,cinder:SELECT=40,cinder:DELETE=2 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:22:10 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:12 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:SELECT=36,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:22:12 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Status of snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 is now creating {{(pid=88796) _create_snapshot_online /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1924}} Aug 03 09:22:12 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 16.709s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:12 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e1478218-0d06-4e90-a45d-dee09b846381 tempest-SnapshotDataIntegrityTests-1514407722 None] Create snapshot completed successfully Aug 03 09:22:14 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-01d1f81a-1d3c-4374-bc0d-8588bfa2c7f2 req-6b67a1b0-e816-40a5-b03f-2177e333e073 tempest-SnapshotDataIntegrityTests-1514407722 None] Terminate volume connection completed successfully. Aug 03 09:22:14 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-01d1f81a-1d3c-4374-bc0d-8588bfa2c7f2 req-6b67a1b0-e816-40a5-b03f-2177e333e073 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting attachment 7ee75073-b833-4bed-9dbb-02de3fd14559. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (99a92ae1-7f72-4a07-ab9b-973e4951f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1858560a-1096-4715-93d7-674a0a2d61df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1858560a-1096-4715-93d7-674a0a2d61df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1997246810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd3b605-266a-4f38-9105-301097b65329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9cd78d1c14e63824ad10ae05b3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9fabc701-a6fa-475e-b820-80b24aa73d21,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:22:15Z,use_quota=True,user_id='9c1556bf8c8e46ef9cef748a65024371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafab027-4dba-4ab4-9b8a-43131236bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafab027-4dba-4ab4-9b8a-43131236bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d0641-b9aa-44b5-97d0-f183c4c7060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (305d0641-b9aa-44b5-97d0-f183c4c7060b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4dd3b605-266a-4f38-9105-301097b65329', 'volume_name': 'volume-4dd3b605-266a-4f38-9105-301097b65329', 'volume_size': 1, 'snapshot_id': '9fabc701-a6fa-475e-b820-80b24aa73d21'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a3afeb-6b39-4bf5-993f-8fb9edfcf9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a3afeb-6b39-4bf5-993f-8fb9edfcf9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46a6c13-81a6-4859-8563-04cbedb52132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:15 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Volume 4dd3b605-266a-4f38-9105-301097b65329: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4dd3b605-266a-4f38-9105-301097b65329', 'volume_size': 1, 'snapshot_id': '9fabc701-a6fa-475e-b820-80b24aa73d21'} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21-4dd3b605-266a-4f38-9105-301097b65329" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21-4dd3b605-266a-4f38-9105-301097b65329" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Creating volume 4dd3b605-266a-4f38-9105-301097b65329 from snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot: 9fabc701-a6fa-475e-b820-80b24aa73d21, volume: 4dd3b605-266a-4f38-9105-301097b65329, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f42054-baf0-452d-870a-c5fddc8a665d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:15 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:15 devstack sudo[116253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:22:15 devstack sudo[116253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:16 devstack sudo[116253]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.354s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c5d23b-6672-41e6-82ce-a165597da774]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:16 devstack sudo[116258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:22:16 devstack sudo[116258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:16 devstack sudo[116258]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.346s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:22:16 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:16 devstack sudo[116263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 Aug 03 09:22:16 devstack sudo[116263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:20 devstack sudo[116263]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329" returned: 0 in 4.004s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f, size 1024.00 MB, duration 4.01 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:22:20 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Converted 1024.00 MB image at 255.66 MB/s Aug 03 09:22:20 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 is being set with open permissions: ugo+rw Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:20 devstack sudo[116277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 Aug 03 09:22:20 devstack sudo[116277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:20 devstack sudo[116277]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329" returned: 0 in 0.230s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" released by "_copy_volume_from_snapshot" :: held 5.008s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21-4dd3b605-266a-4f38-9105-301097b65329" released by "_create_volume_from_snapshot" :: held 5.073s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.089s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c46a6c13-81a6-4859-8563-04cbedb52132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd3b605-266a-4f38-9105-301097b65329', 'volume_size': 1, 'snapshot_id': '9fabc701-a6fa-475e-b820-80b24aa73d21'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96628ddc-691a-4933-b887-aeb674496d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:20 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Volume volume-4dd3b605-266a-4f38-9105-301097b65329 (4dd3b605-266a-4f38-9105-301097b65329): created successfully Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96628ddc-691a-4933-b887-aeb674496d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:20 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (99a92ae1-7f72-4a07-ab9b-973e4951f381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:20 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-dded417f-f79e-4490-9c01-3d2bf84ac22f tempest-SnapshotDataIntegrityTests-1514407722 None] Created volume successfully. Aug 03 09:22:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-1a5dabfb-5297-472b-9260-335b6046bb8e req-f22b7a2b-1472-4413-8db5-e59b60526dcd tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-1a5dabfb-5297-472b-9260-335b6046bb8e req-f22b7a2b-1472-4413-8db5-e59b60526dcd tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:21 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-1a5dabfb-5297-472b-9260-335b6046bb8e req-f22b7a2b-1472-4413-8db5-e59b60526dcd tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:21 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-1a5dabfb-5297-472b-9260-335b6046bb8e req-f22b7a2b-1472-4413-8db5-e59b60526dcd tempest-SnapshotDataIntegrityTests-1514407722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-4dd3b605-266a-4f38-9105-301097b65329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '882b72c6-8dfb-4f49-9b04-cb1fb44ec6fa', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:22:22 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-1a5dabfb-5297-472b-9260-335b6046bb8e req-f22b7a2b-1472-4413-8db5-e59b60526dcd tempest-SnapshotDataIntegrityTests-1514407722 None] attachment_update completed successfully. Aug 03 09:22:25 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-aed48110-3edd-4cf4-9f29-fae80a9cfb0e req-4453d24b-30d3-409a-a243-7206ffee385c tempest-SnapshotDataIntegrityTests-1514407722 None] Terminate volume connection completed successfully. Aug 03 09:22:25 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-aed48110-3edd-4cf4-9f29-fae80a9cfb0e req-4453d24b-30d3-409a-a243-7206ffee385c tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting attachment 882b72c6-8dfb-4f49-9b04-cb1fb44ec6fa. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (17470073-8c89-4f1f-b5f4-73a47a658796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1abe4d9-a888-4d8d-83b7-4a389284386e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1abe4d9-a888-4d8d-83b7-4a389284386e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1860766713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545692ed-4ca2-42e6-8451-7602eaf1e40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9cd78d1c14e63824ad10ae05b3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e84acc5f-62ee-4bfb-a019-c1143428457f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:22:27Z,use_quota=True,user_id='9c1556bf8c8e46ef9cef748a65024371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d46ddfa-ae60-4d9e-a58b-af6a805ff642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d46ddfa-ae60-4d9e-a58b-af6a805ff642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5859dc-680c-4ac1-a34c-5d87394f1ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5859dc-680c-4ac1-a34c-5d87394f1ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '545692ed-4ca2-42e6-8451-7602eaf1e40c', 'volume_name': 'volume-545692ed-4ca2-42e6-8451-7602eaf1e40c', 'volume_size': 1, 'snapshot_id': 'e84acc5f-62ee-4bfb-a019-c1143428457f'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f787073b-3ac8-480c-a988-4739f64ca24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f787073b-3ac8-480c-a988-4739f64ca24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c48a21f-4912-48d1-9c30-c6c72321fd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:26 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume 545692ed-4ca2-42e6-8451-7602eaf1e40c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-545692ed-4ca2-42e6-8451-7602eaf1e40c', 'volume_size': 1, 'snapshot_id': 'e84acc5f-62ee-4bfb-a019-c1143428457f'} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f-545692ed-4ca2-42e6-8451-7602eaf1e40c" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f-545692ed-4ca2-42e6-8451-7602eaf1e40c" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating volume 545692ed-4ca2-42e6-8451-7602eaf1e40c from snapshot e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:26 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot: e84acc5f-62ee-4bfb-a019-c1143428457f, volume: 545692ed-4ca2-42e6-8451-7602eaf1e40c, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6df8cc-a3fc-44f0-8682-182690290f8b]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:27 devstack sudo[116736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:27 devstack sudo[116736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:27 devstack sudo[116736]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.371s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[214cd1c1-fd45-4a81-bb79-b09c3373d8d3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:27 devstack sudo[116741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:22:27 devstack sudo[116741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:27 devstack sudo[116741]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.348s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:22:27 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:27 devstack sudo[116747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c Aug 03 09:22:27 devstack sudo[116747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:32 devstack sudo[116747]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c" returned: 0 in 4.340s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:22:32 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Converted 1024.00 MB image at 235.88 MB/s Aug 03 09:22:32 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c is being set with open permissions: ugo+rw Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:32 devstack sudo[116761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c Aug 03 09:22:32 devstack sudo[116761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:32 devstack sudo[116761]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" released by "_copy_volume_from_snapshot" :: held 5.381s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f-545692ed-4ca2-42e6-8451-7602eaf1e40c" released by "_create_volume_from_snapshot" :: held 5.447s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.465s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c48a21f-4912-48d1-9c30-c6c72321fd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545692ed-4ca2-42e6-8451-7602eaf1e40c', 'volume_size': 1, 'snapshot_id': 'e84acc5f-62ee-4bfb-a019-c1143428457f'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792d0047-e9c9-4db1-89f3-c3d31a4fc495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:32 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume volume-545692ed-4ca2-42e6-8451-7602eaf1e40c (545692ed-4ca2-42e6-8451-7602eaf1e40c): created successfully Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792d0047-e9c9-4db1-89f3-c3d31a4fc495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:32 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (17470073-8c89-4f1f-b5f4-73a47a658796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:32 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e60a9831-1f4d-4670-a440-6f2f847d3a35 tempest-SnapshotDataIntegrityTests-1514407722 None] Created volume successfully. Aug 03 09:22:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-b869e831-4a66-41fd-aecc-1989cd391f6a req-05ebc8ac-46c9-4bd4-9132-5a38b1e859de tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-b869e831-4a66-41fd-aecc-1989cd391f6a req-05ebc8ac-46c9-4bd4-9132-5a38b1e859de tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:34 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-b869e831-4a66-41fd-aecc-1989cd391f6a req-05ebc8ac-46c9-4bd4-9132-5a38b1e859de tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:34 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-b869e831-4a66-41fd-aecc-1989cd391f6a req-05ebc8ac-46c9-4bd4-9132-5a38b1e859de tempest-SnapshotDataIntegrityTests-1514407722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-545692ed-4ca2-42e6-8451-7602eaf1e40c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9ff1f6a-e07e-4d2f-b2df-9f8084450895', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:22:34 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-b869e831-4a66-41fd-aecc-1989cd391f6a req-05ebc8ac-46c9-4bd4-9132-5a38b1e859de tempest-SnapshotDataIntegrityTests-1514407722 None] attachment_update completed successfully. Aug 03 09:22:38 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-d4beefd2-1cc6-47a9-959d-8019870d020f req-2a4b9a2d-e1aa-4adf-a83d-86a6e4be79f0 tempest-SnapshotDataIntegrityTests-1514407722 None] Terminate volume connection completed successfully. Aug 03 09:22:38 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-d4beefd2-1cc6-47a9-959d-8019870d020f req-2a4b9a2d-e1aa-4adf-a83d-86a6e4be79f0 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting attachment c9ff1f6a-e07e-4d2f-b2df-9f8084450895. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88796) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (e316b704-2f82-49ca-a3be-6281e8563bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f93fdc-0a8b-4b3a-924a-f6dd90a54589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f93fdc-0a8b-4b3a-924a-f6dd90a54589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-921219300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70520d0-0e0a-4e73-97f9-75b109cd3121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1b9cd78d1c14e63824ad10ae05b3654',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T07:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5991035-2a4f-4fbe-83c0-50c6a6136b37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T07:22:39Z,use_quota=True,user_id='9c1556bf8c8e46ef9cef748a65024371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(63706260-14d2-41ab-9bc9-9e9fce3e07ed),volume_type_id=63706260-14d2-41ab-9bc9-9e9fce3e07ed)' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb6e73-1794-4186-b02e-c17dda0e532b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9bb6e73-1794-4186-b02e-c17dda0e532b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea1f1cf-acf3-42cb-ac87-81b38b1a667c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea1f1cf-acf3-42cb-ac87-81b38b1a667c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c70520d0-0e0a-4e73-97f9-75b109cd3121', 'volume_name': 'volume-c70520d0-0e0a-4e73-97f9-75b109cd3121', 'volume_size': 1, 'snapshot_id': 'd5991035-2a4f-4fbe-83c0-50c6a6136b37'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4f6ba0-5a18-4ee7-8a6f-80137e6b886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4f6ba0-5a18-4ee7-8a6f-80137e6b886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8ef0e3-d7af-4e3e-9e04-afa7b7ef00d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:39 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume c70520d0-0e0a-4e73-97f9-75b109cd3121: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c70520d0-0e0a-4e73-97f9-75b109cd3121', 'volume_size': 1, 'snapshot_id': 'd5991035-2a4f-4fbe-83c0-50c6a6136b37'} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37-c70520d0-0e0a-4e73-97f9-75b109cd3121" by "_create_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37-c70520d0-0e0a-4e73-97f9-75b109cd3121" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating volume c70520d0-0e0a-4e73-97f9-75b109cd3121 from snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Selected osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef as target Quobyte volume. {{(pid=88796) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" by "_copy_volume_from_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot: d5991035-2a4f-4fbe-83c0-50c6a6136b37, volume: c70520d0-0e0a-4e73-97f9-75b109cd3121, {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b992f13-0784-44cd-a062-66403e989113]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:39 devstack sudo[117217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:22:39 devstack sudo[117217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:39 devstack sudo[117217]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.345s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb2e909-0ecd-4c2a-8481-7fd31d16c8eb]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:39 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:39 devstack sudo[117222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:39 devstack sudo[117222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:40 devstack sudo[117222]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.352s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Creating direct copy from snapshot {{(pid=88796) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG cinder.utils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Path /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 not found in is_blk_device check {{(pid=88796) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 09:22:40 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:40 devstack sudo[117227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 Aug 03 09:22:40 devstack sudo[117227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:44 devstack sudo[117227]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121" returned: 0 in 4.214s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.image.image_utils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Image conversion details: src /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 {{(pid=88796) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 09:22:44 devstack cinder-volume[88796]: INFO cinder.image.image_utils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Converted 1024.00 MB image at 242.94 MB/s Aug 03 09:22:44 devstack cinder-volume[88796]: WARNING cinder.volume.drivers.remotefs [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 is being set with open permissions: ugo+rw Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:44 devstack sudo[117240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 Aug 03 09:22:44 devstack sudo[117240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:44 devstack sudo[117240]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121" returned: 0 in 0.266s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" released by "_copy_volume_from_snapshot" :: held 5.252s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37-c70520d0-0e0a-4e73-97f9-75b109cd3121" released by "_create_volume_from_snapshot" :: held 5.313s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.327s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8ef0e3-d7af-4e3e-9e04-afa7b7ef00d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70520d0-0e0a-4e73-97f9-75b109cd3121', 'volume_size': 1, 'snapshot_id': 'd5991035-2a4f-4fbe-83c0-50c6a6136b37'}' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a88c35e-0e1d-4659-a4c7-1d2ecf664e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 09:22:44 devstack cinder-volume[88796]: INFO cinder.volume.flows.manager.create_volume [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Volume volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 (c70520d0-0e0a-4e73-97f9-75b109cd3121): created successfully Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a88c35e-0e1d-4659-a4c7-1d2ecf664e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88796) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 09:22:44 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Flow 'volume_create_manager' (e316b704-2f82-49ca-a3be-6281e8563bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88796) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 09:22:44 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2c9cb766-55af-4ff6-a932-9d5fdfe92018 tempest-SnapshotDataIntegrityTests-1514407722 None] Created volume successfully. Aug 03 09:22:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4ebed549-2e3f-42c9-b434-20e42646f535 req-38ec13c0-e739-488b-963d-a59fd3b9bdee tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4ebed549-2e3f-42c9-b434-20e42646f535 req-38ec13c0-e739-488b-963d-a59fd3b9bdee tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:46 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [req-4ebed549-2e3f-42c9-b434-20e42646f535 req-38ec13c0-e739-488b-963d-a59fd3b9bdee tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:46 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-4ebed549-2e3f-42c9-b434-20e42646f535 req-38ec13c0-e739-488b-963d-a59fd3b9bdee tempest-SnapshotDataIntegrityTests-1514407722 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef', 'name': 'volume-c70520d0-0e0a-4e73-97f9-75b109cd3121', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '030f7615-3397-4712-acc2-30f37d941fd6', 'enforce_multipath': True} {{(pid=88796) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 09:22:46 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-4ebed549-2e3f-42c9-b434-20e42646f535 req-38ec13c0-e739-488b-963d-a59fd3b9bdee tempest-SnapshotDataIntegrityTests-1514407722 None] attachment_update completed successfully. Aug 03 09:22:50 devstack cinder-volume[88796]: INFO cinder.volume.manager [req-4efdf1d0-bb84-4972-8a73-d9bcb5647eb0 req-fed67f31-b110-4e82-809c-aee4c0d38042 tempest-SnapshotDataIntegrityTests-1514407722 None] Terminate volume connection completed successfully. Aug 03 09:22:50 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [req-4efdf1d0-bb84-4972-8a73-d9bcb5647eb0 req-fed67f31-b110-4e82-809c-aee4c0d38042 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting attachment 030f7615-3397-4712-acc2-30f37d941fd6. {{(pid=88796) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-c70520d0-0e0a-4e73-97f9-75b109cd3121-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-c70520d0-0e0a-4e73-97f9-75b109cd3121-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" acquired by "delete_volume" :: waited 0.019s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00b7e4d-7845-41ec-9959-637448f3c374]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:51 devstack sudo[117740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 Aug 03 09:22:51 devstack sudo[117740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:51 devstack sudo[117740]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:51 devstack sudo[117745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121 Aug 03 09:22:51 devstack sudo[117745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:51 devstack sudo[117745]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:51 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-c70520d0-0e0a-4e73-97f9-75b109cd3121" returned: 0 in 0.260s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-c70520d0-0e0a-4e73-97f9-75b109cd3121" released by "delete_volume" :: held 0.727s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['9723ce93-edd0-46f4-8fc6-d479d0d217f4', 'e781a131-54f8-486c-8e6f-b7a531a9f51f', 'e04481c3-bab2-414f-bdcc-7662cc091e5d', 'e5376066-abcd-4411-acb6-019493d26e11'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:52 devstack sudo[117748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:22:52 devstack sudo[117748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:52 devstack sudo[117748]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.270s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:22:52 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleted volume successfully. Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-8f4ac8e9-9a02-41ce-b7cc-af3a8ef6a469 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-c70520d0-0e0a-4e73-97f9-75b109cd3121-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-545692ed-4ca2-42e6-8451-7602eaf1e40c-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-545692ed-4ca2-42e6-8451-7602eaf1e40c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e4ac13-2456-463f-a9ce-bbb7c18359c3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:52 devstack sudo[117751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c Aug 03 09:22:52 devstack sudo[117751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:52 devstack sudo[117751]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c" returned: 0 in 0.374s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:52 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:53 devstack sudo[117756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c Aug 03 09:22:53 devstack sudo[117756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:53 devstack sudo[117756]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-545692ed-4ca2-42e6-8451-7602eaf1e40c" returned: 0 in 0.251s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-545692ed-4ca2-42e6-8451-7602eaf1e40c" released by "delete_volume" :: held 0.673s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['9cd9a0bd-0d24-4aae-aaed-1ae5e347f226', 'c2e27eae-c983-4c1f-af1d-c0cc6c75ebd2', '3f48eb78-456a-4fb0-b42e-5320f58b4bef', 'e819b336-f3e3-4138-88fe-bd56809bd9d8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:53 devstack sudo[117765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:22:53 devstack sudo[117765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:53 devstack sudo[117765]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.256s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:22:53 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Deleted volume successfully. Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-669ea253-26a8-4f2d-a811-28d75bb2f91f tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-545692ed-4ca2-42e6-8451-7602eaf1e40c-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-4dd3b605-266a-4f38-9105-301097b65329-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-4dd3b605-266a-4f38-9105-301097b65329-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" acquired by "delete_volume" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5cb10b-b113-40c2-bb8f-4389dfc11e31]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:53 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:54 devstack sudo[117768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 Aug 03 09:22:54 devstack sudo[117768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:54 devstack sudo[117768]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329" returned: 0 in 0.344s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:54 devstack sudo[117773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329 Aug 03 09:22:54 devstack sudo[117773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:54 devstack sudo[117773]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-4dd3b605-266a-4f38-9105-301097b65329" returned: 0 in 0.239s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-4dd3b605-266a-4f38-9105-301097b65329" released by "delete_volume" :: held 0.624s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['556b45ba-4e46-4c2c-b979-5fc8bda145cf', 'da5ced28-0399-4d9a-aeab-b99ad4db720c', '9248caf1-0732-47dd-b74c-9beb39ac2d1d', 'd749e999-4d42-41b8-8bd0-85d02c256b80'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:54 devstack sudo[117776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:22:54 devstack sudo[117776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:54 devstack sudo[117776]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.240s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:22:54 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleted volume successfully. Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-2cff7848-fb34-4acf-91ca-09ff3a127284 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-4dd3b605-266a-4f38-9105-301097b65329-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-d5991035-2a4f-4fbe-83c0-50c6a6136b37-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-d5991035-2a4f-4fbe-83c0-50c6a6136b37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:54 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting offline snapshot d5991035-2a4f-4fbe-83c0-50c6a6136b37 of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot_file for this snap is: volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1f8c6f-5a9d-4451-acef-4fe8b87259f8]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:55 devstack sudo[117779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:22:55 devstack sudo[117779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:55 devstack sudo[117779]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.368s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb18725-2eff-42a4-84a2-e5179982bcc6]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:55 devstack sudo[117784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:55 devstack sudo[117784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:55 devstack sudo[117784]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.355s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:55 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:55 devstack sudo[117789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:22:55 devstack sudo[117789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:56 devstack sudo[117789]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.566s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:56 devstack sudo[117794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37 Aug 03 09:22:56 devstack sudo[117794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:56 devstack sudo[117794]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.d5991035-2a4f-4fbe-83c0-50c6a6136b37" returned: 0 in 0.277s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-d5991035-2a4f-4fbe-83c0-50c6a6136b37" released by "_delete_snapshot" :: held 1.651s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" released by "delete_snapshot" :: held 1.671s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['d23fba8d-cca6-47b3-b7a6-87253804e9a2', '644bbd20-325b-4c24-955c-e6f31ea5e099', 'ab767197-bbc3-4bf0-8323-65c5bf193d01', 'd18c74be-8ae6-4d23-ab83-e0d6f4c1455c'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:22:56 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Delete snapshot completed successfully. Aug 03 09:22:56 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-721fd209-bfc4-42be-aaa1-b55e68d9ecff tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-d5991035-2a4f-4fbe-83c0-50c6a6136b37-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-e84acc5f-62ee-4bfb-a019-c1143428457f-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-e84acc5f-62ee-4bfb-a019-c1143428457f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting offline snapshot e84acc5f-62ee-4bfb-a019-c1143428457f of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot_file for this snap is: volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9de0ea-516b-4c2b-87a7-c8847a64457e]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:57 devstack sudo[117797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:57 devstack sudo[117797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:57 devstack sudo[117797]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.367s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9d7dc-1b96-4cbf-a230-0a00d3a380b3]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:57 devstack sudo[117802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:22:57 devstack sudo[117802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:57 devstack sudo[117802]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.349s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:57 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:57 devstack sudo[117807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:57 devstack sudo[117807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:58 devstack sudo[117807]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.416s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:58 devstack sudo[117817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f Aug 03 09:22:58 devstack sudo[117817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:58 devstack sudo[117817]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.e84acc5f-62ee-4bfb-a019-c1143428457f" returned: 0 in 0.235s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-e84acc5f-62ee-4bfb-a019-c1143428457f" released by "_delete_snapshot" :: held 1.461s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" released by "delete_snapshot" :: held 1.484s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['bbc5d576-dd8a-4be6-a8dd-09cbe18e5fa3', '43da6dff-d757-497a-b7bb-3d0a9df6951e', '84f17fef-cd59-45ed-bb07-f67cfbab5339', '34b25e13-ea90-4153-82cd-4bbd20dea125'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:22:58 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Delete snapshot completed successfully. Aug 03 09:22:58 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-4ecc05a2-f009-42fd-965c-f95fbd1cf62b tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-e84acc5f-62ee-4bfb-a019-c1143428457f-delete_snapshot" released by "delete_snapshot" :: held 1.609s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-9fabc701-a6fa-475e-b820-80b24aa73d21-delete_snapshot" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-9fabc701-a6fa-475e-b820-80b24aa73d21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" by "delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21" by "_delete_snapshot" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Deleting offline snapshot 9fabc701-a6fa-475e-b820-80b24aa73d21 of volume 8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] snapshot_file for this snap is: volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a0e96-8b68-43c1-9292-b1879610eb09]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:59 devstack sudo[117821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:22:59 devstack sudo[117821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:22:59 devstack sudo[117821]: pam_unix(sudo:session): session closed for user root Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.360s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.remotefs [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88796) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[c685659f-e411-43fb-ba23-e8bd2d759823]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:22:59 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:22:59 devstack sudo[117826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:22:59 devstack sudo[117826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:00 devstack sudo[117826]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.359s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:00 devstack sudo[117832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:23:00 devstack sudo[117832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:00 devstack sudo[117832]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.380s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:00 devstack sudo[117842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21 Aug 03 09:23:00 devstack sudo[117842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:00 devstack sudo[117842]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f.9fabc701-a6fa-475e-b820-80b24aa73d21" returned: 0 in 0.240s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-9fabc701-a6fa-475e-b820-80b24aa73d21" released by "_delete_snapshot" :: held 1.442s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" released by "delete_snapshot" :: held 1.464s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['527ba334-08d0-43de-8d31-9f7848c7c3f0', '14805b54-f534-4a71-b673-6faf83da278c', 'be9fc65e-41b2-40be-a642-b5671d92f28a', 'c2dfbdc4-6a3a-4316-9b82-5bd4e6b797ac'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:23:00 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Delete snapshot completed successfully. Aug 03 09:23:00 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-e18833af-4da1-40df-ac43-f29a1719948e tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-9fabc701-a6fa-475e-b820-80b24aa73d21-delete_snapshot" released by "delete_snapshot" :: held 1.598s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f-delete_volume" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" by "delete_volume" {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" acquired by "delete_volume" :: waited 0.018s {{(pid=88796) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a09bc-996c-47be-bc39-db232c22ee9d]: (4, 'qcow2') {{(pid=90223) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 09:23:01 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:01 devstack sudo[117847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:23:01 devstack sudo[117847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:02 devstack sudo[117847]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.353s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:02 devstack sudo[117852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f Aug 03 09:23:02 devstack sudo[117852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:02 devstack sudo[117852]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002/volume-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" returned: 0 in 0.245s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-quobyte-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f" released by "delete_volume" :: held 0.678s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.quota [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Created reservations ['07ec7cfb-e169-42b6-b1c4-a96ff6445e19', 'fadfc41b-d4bf-40a5-80ae-38b0c954672b', '840147e3-9b27-46a4-bef8-f559dc345dbe', '123f0918-a698-4e45-b624-652d4c21c2e8'] {{(pid=88796) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:02 devstack sudo[117855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:23:02 devstack sudo[117855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:02 devstack sudo[117855]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.249s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:23:02 devstack cinder-volume[88796]: INFO cinder.volume.manager [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Deleted volume successfully. Aug 03 09:23:02 devstack cinder-volume[88796]: DEBUG cinder.coordination [None req-f78c8d57-66c6-4200-ba99-b467079741b8 tempest-SnapshotDataIntegrityTests-1514407722 None] Lock "cinder-8d0c43ee-e151-47fa-8bf0-5db5c5f76a6f-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=88796) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef': None} {{(pid=88796) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG cinder.volume.drivers.quobyte [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-38bd988a-78a0-44e4-b283-a4aaabbe35ef'] {{(pid=88796) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.lockutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88796) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 09:23:08 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 09:23:08 devstack sudo[117887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002 Aug 03 09:23:08 devstack sudo[117887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 09:23:09 devstack sudo[117887]: pam_unix(sudo:session): session closed for user root Aug 03 09:23:09 devstack cinder-volume[88796]: DEBUG oslo_concurrency.processutils [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a23e290c90b600023686e5ae6cccf002" returned: 0 in 0.261s {{(pid=88796) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 09:23:09 devstack cinder-volume[88796]: DEBUG cinder.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Notifying Schedulers of capabilities ... {{(pid=88796) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 09:23:09 devstack cinder-volume[88796]: DEBUG oslo_service.periodic_task [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] Running periodic task VolumeManager._thread_info {{(pid=88796) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 09:23:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread count: 28 {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 09:23:09 devstack cinder-volume[88796]: DEBUG cinder.volume.manager [None req-0e22436e-dfe3-4ea7-abed-43523cd9e76f None None] thread info: [<_MainThread(MainThread, started 129529074430080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88796) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 09:23:12 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=64,cinder:SELECT=66,cinder:INSERT=14,cinder:DELETE=1 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 09:23:12 devstack cinder-volume[88796]: DEBUG dbcounter [-] [88796] Writing DB stats cinder:UPDATE=63,cinder:DELETE=7,cinder:SELECT=75,cinder:INSERT=17 {{(pid=88796) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}